Jul 22 12:02:25 devstack cinder-volume[76343]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 22 12:02:25 devstack cinder-volume[76343]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 22 12:02:25 devstack cinder-volume[76343]: we strongly recommend against using it for new projects. Jul 22 12:02:25 devstack cinder-volume[76343]: If you are already using Eventlet, we recommend migrating to a different Jul 22 12:02:25 devstack cinder-volume[76343]: framework. For more detail see Jul 22 12:02:25 devstack cinder-volume[76343]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 22 12:02:25 devstack cinder-volume[76343]: import eventlet # noqa Jul 22 12:02:28 devstack cinder-volume[76343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76343) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 12:02:28 devstack cinder-volume[76343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76343) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 12:02:28 devstack cinder-volume[76343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76343) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 12:02:29 devstack cinder-volume[76343]: INFO dbcounter [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Registered counter for database cinder Jul 22 12:02:29 devstack cinder-volume[76343]: DEBUG oslo_db.sqlalchemy.engines [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76343) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 12:02:30 devstack cinder-volume[76343]: DEBUG dbcounter [-] [76343] Writer thread running {{(pid=76343) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 12:02:30 devstack cinder-volume[76343]: INFO cinder.rpc [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 22 12:02:30 devstack cinder-volume[76343]: INFO cinder.rpc [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 22 12:02:30 devstack cinder-volume[76343]: DEBUG oslo_db.sqlalchemy.engines [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76343) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 12:02:30 devstack cinder-volume[76343]: INFO cinder.volume.manager [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Determined volume DB was empty at startup. Jul 22 12:02:30 devstack cinder-volume[76343]: DEBUG cinder.volume.manager [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76343) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 22 12:02:30 devstack cinder-volume[76343]: INFO cinder.volume.manager [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 22 12:02:30 devstack cinder-volume[76343]: WARNING stevedore.named [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 22 12:02:30 devstack cinder-volume[76343]: WARNING castellan.key_manager [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 12:02:30 devstack cinder-volume[76343]: WARNING cinder.keymgr.conf_key_mgr [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 12:02:30 devstack cinder-volume[76343]: DEBUG cinder.volume.drivers.lvm [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76343) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 22 12:02:30 devstack cinder-volume[76343]: DEBUG oslo_concurrency.processutils [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76343) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:30 devstack cinder-volume[76343]: DEBUG oslo_concurrency.processutils [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] CMD "cinder-rtstool verify" returned: 0 in 0.457s {{(pid=76343) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:30 devstack cinder-volume[76343]: DEBUG oslo_db.sqlalchemy.engines [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76343) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 12:02:30 devstack cinder-volume[76343]: INFO cinder.rpc [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 22 12:02:30 devstack cinder-volume[76343]: INFO cinder.rpc [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 22 12:02:30 devstack cinder-volume[76343]: WARNING stevedore.named [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 22 12:02:30 devstack cinder-volume[76343]: WARNING castellan.key_manager [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 12:02:30 devstack cinder-volume[76343]: INFO cinder.volume.manager [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 22 12:02:30 devstack cinder-volume[76343]: DEBUG oslo_db.sqlalchemy.engines [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76343) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 12:02:31 devstack cinder-volume[76343]: INFO oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Starting 1 workers Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Started child 76530 {{(pid=76343) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Full set of CONF: {{(pid=76343) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] ******************************************************************************** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Configuration options gathered from: {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] ================================================================================ {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] allow_availability_zone_fallback = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] allow_compression_on_image_upload = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] allowed_direct_url_schemes = [] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76530]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] api_rate_limit = True {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] auth_strategy = keystone {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] az_cache_duration = 3600 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_availability_zone = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_host = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_name = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_stats_polling_interval = 60 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backup_api_class = cinder.backup.api.API {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backup_name_template = backup-%s {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backup_use_same_host = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backup_use_temp_snapshot = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] chap_password = **** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] chap_username = {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cinder_internal_tenant_project_id = d2dc0e788a5e4457857d6a23692e843a {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cinder_internal_tenant_user_id = b111b7224bba4f1880efcd0cac3135da {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cloned_volume_same_az = True {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cluster = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] compression_format = gzip {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] compute_api_class = cinder.compute.nova.API {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] config_dir = [] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] config_source = [] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] control_exchange = openstack {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] debug = True {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] default_availability_zone = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] default_group_type = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] default_volume_type = lvmdriver-1 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] disk_geometry = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] driver_client_cert = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] driver_client_cert_key = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] driver_data_namespace = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] driver_ssl_cert_path = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] driver_ssl_cert_verify = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] driver_use_ssl = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] enable_force_upload = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] enable_new_services = True {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] enable_unsupported_driver = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] enabled_backends = ['lvmdriver-1'] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] enforce_multipath_for_image_xfer = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] filter_function = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] glance_api_insecure = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] glance_api_servers = ['http://192.168.122.102/image'] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] glance_api_ssl_compression = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] glance_ca_certificates_file = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] glance_catalog_info = image:glance:publicURL {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] glance_certfile = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] glance_keyfile = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] glance_num_retries = 3 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] glance_request_timeout = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] goodness_function = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] graceful_shutdown_timeout = 5 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] group_api_class = cinder.group.api.API {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] host = devstack {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] image_compress_on_upload = True {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] image_conversion_address_space_limit = 1 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] image_conversion_cpu_limit = 60 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] image_conversion_disable = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] image_upload_use_cinder_backend = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] image_upload_use_internal_tenant = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] image_volume_cache_enabled = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] image_volume_cache_max_count = 0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] image_volume_cache_max_size_gb = 0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] init_host_max_objects_retrieval = 0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] instance_format = [instance: %(uuid)s] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] iscsi_target_flags = {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] iscsi_write_cache = on {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] iser_helper = tgtadm {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] iser_ip_address = 192.168.122.102 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] iser_port = 3260 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] log_color = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] log_config_append = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] log_dir = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] log_file = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] log_options = True {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] log_rotate_interval = 1 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] log_rotate_interval_type = days {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] log_rotation_type = none {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76530]: INFO cinder.volume.manager [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] max_age = 0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] max_logfile_count = 30 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] max_logfile_size_mb = 200 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] max_over_subscription_ratio = 20.0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] message_reap_interval = 86400 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] message_ttl = 2592000 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] migration_create_volume_timeout_secs = 300 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] monkey_patch = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] monkey_patch_modules = [] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] my_ip = 192.168.122.102 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] no_snapshot_gb_quota = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] num_iser_scan_tries = 3 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] num_shell_tries = 3 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] num_volume_device_scan_tries = 3 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] nvmeof_conn_info_version = 1 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] nvmet_ns_id = 10 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] nvmet_port_id = 1 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] osapi_max_limit = 1000 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] osapi_volume_ext_list = [] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] osapi_volume_listen = 0.0.0.0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] osapi_volume_listen_port = 8776 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] osapi_volume_use_ssl = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] osapi_volume_workers = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] per_volume_size_limit = -1 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] periodic_fuzzy_delay = 60 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] periodic_interval = 60 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] project_id_regex = [0-9a-f\-]+ {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] public_endpoint = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] publish_errors = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] quota_backup_gigabytes = 1000 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] quota_backups = 10 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] quota_gigabytes = 1000 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] quota_groups = 10 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] quota_snapshots = 10 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] quota_volumes = 10 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] rate_limit_burst = 0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] rate_limit_except_level = CRITICAL {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] rate_limit_interval = 0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] reinit_driver_count = 3 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] replication_device = **** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] report_discard_supported = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] report_interval = 120 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] reservation_clean_interval = 86400 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] reservation_expire = 86400 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] reserved_image_namespaces = [] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] reserved_percentage = 0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] rpc_response_timeout = 120 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] run_external_periodic_tasks = True {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] scst_target_driver = iscsi {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] scst_target_iqn_name = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] service_down_time = 720 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] shell_completion = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] snapshot_name_template = snapshot-%s {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] snapshot_same_host = True {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] split_loggers = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] state_path = /opt/stack/data/cinder {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] storage_availability_zone = nova {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] storage_protocol = iSCSI {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] syslog_log_facility = LOG_USER {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] target_helper = lioadm {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] target_ip_address = 192.168.122.102 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] target_port = 3260 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] target_protocol = iscsi {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] target_secondary_ip_addresses = [] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] trace_flags = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] transfer_api_class = cinder.transfer.api.API {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] transport_url = **** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] until_refresh = 0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] use_chap_auth = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] use_default_quota_class = True {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] use_journal = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] use_json = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] use_multipath_for_image_xfer = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] use_stderr = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] use_syslog = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] verify_glance_signatures = enabled {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] volume_api_class = cinder.volume.api.API {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] volume_backend_name = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] volume_clear = zero {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] volume_clear_ionice = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] volume_clear_size = 0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] volume_copy_bps_limit = 0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] volume_dd_blocksize = 1M {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] volume_name_template = volume-%s {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] volume_service_inithost_offload = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] volume_usage_audit_period = month {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] zoning_mode = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_concurrency.disable_process_locking = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.auth_section = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.auth_type = password {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.auth_version = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.cache = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.certfile = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.delay_auth_decision = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.http_connect_timeout = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.include_service_catalog = True {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.insecure = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.interface = public {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.keyfile = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.memcache_password = {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.memcache_username = {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.region_name = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.service_token_roles_required = True {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.service_type = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.token_cache_time = 300 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.102/identity {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.backend = dogpile.cache.null {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.backend_argument = **** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.backend_expiration_time = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.config_prefix = cache.oslo {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.debug_cache_backend = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.enable_retry_client = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.enable_socket_keepalive = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.enabled = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.expiration_time = 600 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.hashclient_retry_attempts = 2 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.memcache_dead_retry = 300 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.memcache_pool_maxsize = 10 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.memcache_sasl_enabled = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.password = **** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.proxies = [] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.redis_db = 0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.redis_sentinel_service_name = mymaster {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.redis_server = localhost:6379 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.retry_attempts = 2 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.retry_delay = 0.0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.socket_keepalive_count = 1 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.socket_keepalive_idle = 1 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.socket_keepalive_interval = 1 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.socket_timeout = 1.0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.tls_allowed_ciphers = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.tls_cafile = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.tls_certfile = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.tls_enabled = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.tls_keyfile = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cache.username = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] coordination.backend_url = **** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.asyncio_connection = **** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.asyncio_slave_connection = **** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.backend = sqlalchemy {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.connection = **** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.connection_debug = 0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.connection_parameters = {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.connection_recycle_time = 3600 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.connection_trace = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.db_inc_retry_interval = True {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.db_max_retries = 20 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.db_max_retry_interval = 10 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.db_retry_interval = 1 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.max_overflow = 50 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.max_pool_size = 5 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.max_retries = 10 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.mysql_wsrep_sync_wait = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.pool_timeout = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.retry_interval = 10 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.slave_connection = **** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.sqlite_synchronous = True {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.synchronous_reader = True {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] database.use_db_reconnect = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] profiler.connection_string = messaging:// {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] profiler.enabled = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] profiler.es_doc_type = notification {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] profiler.es_scroll_size = 10000 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] profiler.es_scroll_time = 2m {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] profiler.filter_error_trace = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] profiler.hmac_keys = **** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] profiler.sentinel_service_name = mymaster {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] profiler.socket_timeout = 0.1 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] profiler.trace_requests = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] profiler.trace_sqlalchemy = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] profiler_jaeger.process_tags = {} {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] profiler_jaeger.service_name_prefix = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] profiler_otlp.service_name_prefix = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_policy.enforce_new_defaults = True {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_policy.policy_default_rule = default {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_policy.policy_file = policy.yaml {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack sudo[76583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 22 12:02:31 devstack sudo[76583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_policy.remote_timeout = 60.0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] privsep_osbrick.group = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] privsep_osbrick.helper_command = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] privsep_osbrick.user = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cinder_sys_admin.group = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cinder_sys_admin.helper_command = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] cinder_sys_admin.user = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] service_user.auth_section = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] service_user.auth_type = password {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] service_user.cafile = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] service_user.certfile = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] service_user.collect_timing = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] service_user.insecure = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] service_user.keyfile = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] service_user.send_service_user_token = True {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] service_user.split_loggers = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] service_user.timeout = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] glance.auth_section = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] glance.auth_type = password {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] glance.certfile = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] glance.collect_timing = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] glance.insecure = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] glance.keyfile = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] glance.region_name = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] glance.split_loggers = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] glance.timeout = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.backend_availability_zone = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.chap_password = **** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.chap_username = {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.disk_geometry = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.driver_client_cert = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.driver_client_cert_key = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.driver_data_namespace = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.driver_use_ssl = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.enable_unsupported_driver = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.extra_capabilities = {} {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.filter_function = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.goodness_function = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.iscsi_target_flags = {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.iscsi_write_cache = on {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.iser_helper = tgtadm {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.iser_ip_address = 192.168.122.102 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.iser_port = 3260 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.lvm_mirrors = 0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.lvm_share_target = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.lvm_type = auto {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.num_shell_tries = 3 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.nvmet_port_id = 1 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.replication_device = **** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.report_discard_supported = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.reserved_percentage = 0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.scst_target_driver = iscsi {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.scst_target_iqn_name = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.storage_protocol = iSCSI {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.target_helper = tgtadm {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.target_ip_address = 192.168.122.102 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.target_port = 3260 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.target_protocol = iscsi {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.trace_flags = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.unique_fqdn_network = True {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.use_chap_auth = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.volume_backend_name = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.volume_clear = zero {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.volume_clear_ionice = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.volume_clear_size = 0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.volume_group = cinder-volumes {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_reports.file_event_handler = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_reports.log_dir = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.backend_availability_zone = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.backend_host = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.chap_password = **** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.chap_username = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.chiscsi_conf = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.disk_geometry = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.driver_client_cert = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.driver_data_namespace = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.driver_use_ssl = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.extra_capabilities = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.filter_function = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.goodness_function = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.iser_helper = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.iser_ip_address = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.iser_port = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.iser_target_prefix = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.lvm_conf_file = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.lvm_mirrors = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.lvm_share_target = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.lvm_type = auto {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.num_shell_tries = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.nvmet_port_id = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.replication_device = **** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.report_discard_supported = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.reserved_percentage = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.scst_target_driver = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.storage_protocol = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.target_helper = lioadm {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.target_ip_address = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.target_port = 3260 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.target_protocol = iscsi {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.trace_flags = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.use_chap_auth = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.volume_clear = zero {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.volume_clear_size = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] lvmdriver-1.volumes_dir = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.ssl = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.ssl_version = {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_notifications.driver = [] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_notifications.retry = -1 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] oslo_messaging_notifications.transport_url = **** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] key_manager.fixed_key = **** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican.barbican_api_version = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican.barbican_endpoint = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican.barbican_endpoint_type = public {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican.barbican_region_name = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican.cafile = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican.certfile = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican.collect_timing = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican.insecure = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican.keyfile = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican.number_of_retries = 60 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican.retry_delay = 1 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican.send_service_user_token = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican.split_loggers = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican.timeout = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican.verify_ssl = True {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican.verify_ssl_path = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican_service_user.auth_section = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican_service_user.auth_type = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican_service_user.cafile = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican_service_user.certfile = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican_service_user.collect_timing = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican_service_user.insecure = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican_service_user.keyfile = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican_service_user.split_loggers = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] barbican_service_user.timeout = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] vault.approle_role_id = **** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] vault.approle_secret_id = **** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] vault.auth_method = approle {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] vault.auth_path = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] vault.kv_mountpoint = secret {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] vault.kv_path = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] vault.kv_version = 2 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] vault.namespace = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] vault.root_token_id = **** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] vault.ssl_ca_crt_file = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] vault.timeout = 60.0 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] vault.token_file = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] vault.token_role = None {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] vault.use_ssl = False {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:02:31 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] ******************************************************************************** {{(pid=76343) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 22 12:02:31 devstack sudo[76583]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:31 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:31 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:31 devstack sudo[76682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 12:02:31 devstack sudo[76682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:31 devstack sudo[76682]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:31 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.285s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:31 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:02:31 devstack cinder-volume[76530]: INFO cinder.brick.local_dev.lvm [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 22 12:02:31 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:31 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:31 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:31 devstack sudo[76783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 12:02:31 devstack sudo[76783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:32 devstack sudo[76783]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:32 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:32 devstack cinder-volume[76530]: DEBUG cinder.brick.local_dev.lvm [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76530) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 22 12:02:32 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:32 devstack sudo[76857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 12:02:32 devstack sudo[76857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:32 devstack sudo[76857]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:32 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.632s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:32 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:32 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:32 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:32 devstack sudo[77089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 12:02:32 devstack sudo[77089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:32 devstack sudo[77089]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:32 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:32 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:32 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:32 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:33 devstack sudo[77096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 22 12:02:33 devstack sudo[77096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:33 devstack sudo[77096]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:33 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.321s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:33 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:33 devstack sudo[77184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 12:02:33 devstack sudo[77184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:33 devstack sudo[77184]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:33 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:33 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:33 devstack sudo[77187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 12:02:33 devstack sudo[77187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:33 devstack sudo[77187]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:33 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:33 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:33 devstack sudo[77223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 12:02:33 devstack sudo[77223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:34 devstack sudo[77223]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:34 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.358s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:34 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:34 devstack sudo[77279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 12:02:34 devstack sudo[77279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:34 devstack sudo[77279]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:34 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:34 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:34 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:34 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:34 devstack sudo[77283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 12:02:34 devstack sudo[77283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:34 devstack sudo[77283]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:34 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:34 devstack cinder-volume[76530]: INFO cinder.volume.drivers.lvm [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 22 12:02:34 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:34 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:34 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:34 devstack sudo[77287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 12:02:34 devstack sudo[77287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:35 devstack sudo[77287]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:35 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:35 devstack cinder-volume[76530]: DEBUG cinder.volume.drivers.lvm [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Updating volume stats {{(pid=76530) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 12:02:35 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:35 devstack sudo[77290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 12:02:35 devstack sudo[77290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:35 devstack sudo[77290]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:35 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:35 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:35 devstack sudo[77293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 12:02:35 devstack sudo[77293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:35 devstack sudo[77293]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:35 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:35 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:35 devstack sudo[77303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 12:02:35 devstack sudo[77303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:35 devstack sudo[77303]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:35 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:35 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:35 devstack sudo[77306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 12:02:35 devstack sudo[77306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:36 devstack sudo[77306]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:36 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:36 devstack cinder-volume[76530]: INFO cinder.volume.driver [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Driver hasn't implemented _init_vendor_properties() Jul 22 12:02:36 devstack cinder-volume[76530]: DEBUG cinder.volume.driver [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76530) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 22 12:02:36 devstack cinder-volume[76530]: DEBUG oslo_db.sqlalchemy.engines [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76530) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 12:02:36 devstack cinder-volume[76530]: DEBUG dbcounter [-] [76530] Writer thread running {{(pid=76530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 12:02:36 devstack cinder-volume[76530]: DEBUG cinder.db.api [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Building query based on filter {{(pid=76530) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 22 12:02:36 devstack cinder-volume[76530]: DEBUG cinder.image.image_utils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76530) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 22 12:02:36 devstack cinder-volume[76530]: INFO cinder.keymgr.migration [None req-1d5617dc-af6c-463c-8c85-1c9a997fde2c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 22 12:02:36 devstack cinder-volume[76530]: DEBUG cinder.volume.drivers.lvm [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Updating volume stats {{(pid=76530) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 12:02:36 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:36 devstack sudo[77311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 12:02:36 devstack sudo[77311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:36 devstack sudo[77311]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:36 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:36 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:36 devstack sudo[77314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 12:02:36 devstack sudo[77314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:36 devstack sudo[77314]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:36 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:36 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:36 devstack sudo[77317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 12:02:36 devstack sudo[77317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:37 devstack sudo[77317]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:37 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:37 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:37 devstack sudo[77321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 12:02:37 devstack sudo[77321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:37 devstack sudo[77321]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:37 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:37 devstack cinder-volume[76530]: DEBUG cinder.manager [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Notifying Schedulers of capabilities ... {{(pid=76530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:02:37 devstack cinder-volume[76530]: INFO cinder.volume.manager [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Driver initialization completed successfully. Jul 22 12:02:37 devstack cinder-volume[76530]: INFO cinder.manager [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Initiating service 2 cleanup Jul 22 12:02:37 devstack cinder-volume[76530]: INFO cinder.manager [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Service 2 cleanup completed. Jul 22 12:02:37 devstack cinder-volume[76530]: DEBUG cinder.service [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Creating RPC server for service cinder-volume {{(pid=76530) start /opt/stack/cinder/cinder/service.py:231}} Jul 22 12:02:37 devstack cinder-volume[76530]: DEBUG cinder.service [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76530) start /opt/stack/cinder/cinder/service.py:237}} Jul 22 12:02:37 devstack cinder-volume[76530]: INFO cinder.volume.manager [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 22 12:02:37 devstack cinder-volume[76530]: DEBUG cinder.volume.drivers.lvm [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Updating volume stats {{(pid=76530) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 12:02:37 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:37 devstack sudo[77325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 12:02:37 devstack sudo[77325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:37 devstack sudo[77325]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:37 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:37 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:37 devstack sudo[77328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 12:02:37 devstack sudo[77328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:38 devstack sudo[77328]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:38 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:38 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:38 devstack sudo[77331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 12:02:38 devstack sudo[77331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:38 devstack sudo[77331]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:38 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:38 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:02:38 devstack sudo[77334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 12:02:38 devstack sudo[77334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:02:38 devstack sudo[77334]: pam_unix(sudo:session): session closed for user root Jul 22 12:02:38 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:02:38 devstack cinder-volume[76530]: INFO cinder.volume.manager [None req-7cfa0ace-9051-4b5d-8157-fcc57e77ef3f None None] Driver post RPC initialization completed successfully. Jul 22 12:02:41 devstack cinder-volume[76343]: DEBUG dbcounter [-] [76343] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76343) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:02:48 devstack cinder-volume[76530]: DEBUG dbcounter [-] [76530] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:02:48 devstack cinder-volume[76530]: DEBUG dbcounter [-] [76530] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:03:22 devstack cinder-volume[76530]: DEBUG oslo_service.periodic_task [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Running periodic task VolumeManager._thread_info {{(pid=76530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:03:22 devstack cinder-volume[76530]: DEBUG cinder.volume.manager [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] thread count: 6 {{(pid=76530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:03:22 devstack cinder-volume[76530]: DEBUG cinder.volume.manager [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] thread info: [<_MainThread(MainThread, started 136172025553024)>, , , , , ] {{(pid=76530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:04:22 devstack cinder-volume[76530]: DEBUG oslo_service.periodic_task [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:04:22 devstack cinder-volume[76530]: DEBUG cinder.volume.drivers.lvm [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Updating volume stats {{(pid=76530) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 12:04:22 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:04:22 devstack sudo[82558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 12:04:22 devstack sudo[82558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:04:22 devstack sudo[82558]: pam_unix(sudo:session): session closed for user root Jul 22 12:04:22 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:04:22 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:04:22 devstack sudo[82561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 12:04:22 devstack sudo[82561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:04:23 devstack sudo[82561]: pam_unix(sudo:session): session closed for user root Jul 22 12:04:23 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:04:23 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:04:23 devstack sudo[82564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 12:04:23 devstack sudo[82564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:04:23 devstack sudo[82564]: pam_unix(sudo:session): session closed for user root Jul 22 12:04:23 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:04:23 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:04:23 devstack sudo[82567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 12:04:23 devstack sudo[82567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:04:23 devstack sudo[82567]: pam_unix(sudo:session): session closed for user root Jul 22 12:04:23 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:04:23 devstack cinder-volume[76530]: DEBUG cinder.manager [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Notifying Schedulers of capabilities ... {{(pid=76530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:04:23 devstack cinder-volume[76530]: DEBUG oslo_service.periodic_task [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Running periodic task VolumeManager._thread_info {{(pid=76530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:04:23 devstack cinder-volume[76530]: DEBUG cinder.volume.manager [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] thread count: 6 {{(pid=76530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:04:23 devstack cinder-volume[76530]: DEBUG cinder.volume.manager [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] thread info: [<_MainThread(MainThread, started 136172025553024)>, , , , , ] {{(pid=76530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:04:48 devstack cinder-volume[76530]: DEBUG dbcounter [-] [76530] Writing DB stats cinder:SELECT=1 {{(pid=76530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:04:48 devstack cinder-volume[76530]: DEBUG dbcounter [-] [76530] Writing DB stats cinder:UPDATE=1 {{(pid=76530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:05:22 devstack cinder-volume[76530]: DEBUG oslo_service.periodic_task [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:05:22 devstack cinder-volume[76530]: DEBUG cinder.volume.drivers.lvm [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Updating volume stats {{(pid=76530) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 12:05:22 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:05:22 devstack sudo[84224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 12:05:22 devstack sudo[84224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:05:22 devstack sudo[84224]: pam_unix(sudo:session): session closed for user root Jul 22 12:05:22 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:05:22 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:05:22 devstack sudo[84227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 12:05:22 devstack sudo[84227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:05:23 devstack sudo[84227]: pam_unix(sudo:session): session closed for user root Jul 22 12:05:23 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:05:23 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:05:23 devstack sudo[84250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 12:05:23 devstack sudo[84250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:05:23 devstack sudo[84250]: pam_unix(sudo:session): session closed for user root Jul 22 12:05:23 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:05:23 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:05:23 devstack sudo[84253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 12:05:23 devstack sudo[84253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:05:23 devstack sudo[84253]: pam_unix(sudo:session): session closed for user root Jul 22 12:05:23 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:05:23 devstack cinder-volume[76530]: DEBUG cinder.manager [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Notifying Schedulers of capabilities ... {{(pid=76530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:05:23 devstack cinder-volume[76530]: DEBUG oslo_service.periodic_task [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Running periodic task VolumeManager._thread_info {{(pid=76530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:05:23 devstack cinder-volume[76530]: DEBUG cinder.volume.manager [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] thread count: 6 {{(pid=76530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:05:23 devstack cinder-volume[76530]: DEBUG cinder.volume.manager [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] thread info: [<_MainThread(MainThread, started 136172025553024)>, , , , , ] {{(pid=76530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:06:22 devstack cinder-volume[76530]: DEBUG oslo_service.periodic_task [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:06:22 devstack cinder-volume[76530]: DEBUG cinder.volume.drivers.lvm [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Updating volume stats {{(pid=76530) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 12:06:22 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:06:22 devstack sudo[85502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 12:06:22 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:06:22 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root Jul 22 12:06:22 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:06:22 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:06:22 devstack sudo[85519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 12:06:22 devstack sudo[85519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:06:23 devstack sudo[85519]: pam_unix(sudo:session): session closed for user root Jul 22 12:06:23 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:06:23 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:06:23 devstack sudo[85531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 12:06:23 devstack sudo[85531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:06:23 devstack sudo[85531]: pam_unix(sudo:session): session closed for user root Jul 22 12:06:23 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:06:23 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:06:23 devstack sudo[85534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 12:06:23 devstack sudo[85534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:06:23 devstack sudo[85534]: pam_unix(sudo:session): session closed for user root Jul 22 12:06:23 devstack cinder-volume[76530]: DEBUG oslo_concurrency.processutils [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:06:23 devstack cinder-volume[76530]: DEBUG cinder.manager [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Notifying Schedulers of capabilities ... {{(pid=76530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:06:23 devstack cinder-volume[76530]: DEBUG oslo_service.periodic_task [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] Running periodic task VolumeManager._thread_info {{(pid=76530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:06:23 devstack cinder-volume[76530]: DEBUG cinder.volume.manager [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] thread count: 6 {{(pid=76530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:06:23 devstack cinder-volume[76530]: DEBUG cinder.volume.manager [None req-2665f3b7-7f8a-4a1e-adc6-4304a609951e None None] thread info: [<_MainThread(MainThread, started 136172025553024)>, , , , , ] {{(pid=76530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:06:48 devstack cinder-volume[76530]: DEBUG dbcounter [-] [76530] Writing DB stats cinder:SELECT=1 {{(pid=76530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:06:48 devstack cinder-volume[76530]: DEBUG dbcounter [-] [76530] Writing DB stats cinder:UPDATE=1 {{(pid=76530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:07:11 devstack cinder-volume[76343]: INFO oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Caught SIGTERM, stopping children Jul 22 12:07:11 devstack cinder-volume[76343]: DEBUG oslo_concurrency.lockutils [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Acquiring lock "singleton_lock" {{(pid=76343) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 12:07:11 devstack cinder-volume[76343]: DEBUG oslo_concurrency.lockutils [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Acquired lock "singleton_lock" {{(pid=76343) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 12:07:11 devstack cinder-volume[76343]: DEBUG oslo_concurrency.lockutils [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Releasing lock "singleton_lock" {{(pid=76343) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 12:07:11 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Stop services. {{(pid=76343) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 22 12:07:11 devstack cinder-volume[76343]: DEBUG oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Killing children. {{(pid=76343) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 22 12:07:11 devstack cinder-volume[76343]: INFO oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Waiting on 1 children to exit Jul 22 12:07:12 devstack cinder-volume[76530]: DEBUG oslo_concurrency.lockutils [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Acquiring lock "singleton_lock" {{(pid=76530) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 12:07:12 devstack cinder-volume[76530]: DEBUG oslo_concurrency.lockutils [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Acquired lock "singleton_lock" {{(pid=76530) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 12:07:12 devstack cinder-volume[76530]: DEBUG oslo_concurrency.lockutils [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Releasing lock "singleton_lock" {{(pid=76530) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 12:07:12 devstack cinder-volume[76530]: WARNING amqp [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 22 12:07:12 devstack cinder-volume[76530]: WARNING amqp [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 22 12:07:12 devstack cinder-volume[76343]: INFO oslo_service.backend._eventlet.service [None req-2d2870bf-7b4f-4415-a38c-877cf853960d None None] Child 76530 exited with status 0 Jul 22 12:07:12 devstack cinder-volume[86599]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 22 12:07:12 devstack cinder-volume[86599]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 22 12:07:12 devstack cinder-volume[86599]: we strongly recommend against using it for new projects. Jul 22 12:07:12 devstack cinder-volume[86599]: If you are already using Eventlet, we recommend migrating to a different Jul 22 12:07:12 devstack cinder-volume[86599]: framework. For more detail see Jul 22 12:07:12 devstack cinder-volume[86599]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 22 12:07:12 devstack cinder-volume[86599]: import eventlet # noqa Jul 22 12:07:14 devstack cinder-volume[86599]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86599) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 12:07:14 devstack cinder-volume[86599]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86599) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 12:07:14 devstack cinder-volume[86599]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86599) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 12:07:15 devstack cinder-volume[86599]: INFO dbcounter [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Registered counter for database cinder Jul 22 12:07:15 devstack cinder-volume[86599]: DEBUG oslo_db.sqlalchemy.engines [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86599) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 12:07:15 devstack cinder-volume[86599]: DEBUG dbcounter [-] [86599] Writer thread running {{(pid=86599) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 12:07:15 devstack cinder-volume[86599]: INFO cinder.rpc [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 22 12:07:15 devstack cinder-volume[86599]: INFO cinder.rpc [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 22 12:07:15 devstack cinder-volume[86599]: DEBUG oslo_db.sqlalchemy.engines [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86599) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 12:07:16 devstack cinder-volume[86599]: INFO cinder.volume.manager [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Determined volume DB was empty at startup. Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG cinder.volume.manager [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86599) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 22 12:07:16 devstack cinder-volume[86599]: INFO cinder.volume.manager [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 22 12:07:16 devstack cinder-volume[86599]: WARNING stevedore.named [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 22 12:07:16 devstack cinder-volume[86599]: WARNING castellan.key_manager [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 12:07:16 devstack cinder-volume[86599]: WARNING cinder.keymgr.conf_key_mgr [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 12:07:16 devstack cinder-volume[86599]: INFO cinder.volume.manager [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_db.sqlalchemy.engines [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86599) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 12:07:16 devstack cinder-volume[86599]: INFO oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Starting 1 workers Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Started child 86818 {{(pid=86599) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Full set of CONF: {{(pid=86599) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] ******************************************************************************** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Configuration options gathered from: {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] ================================================================================ {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] allow_availability_zone_fallback = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] allow_compression_on_image_upload = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86818]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] allowed_direct_url_schemes = [] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] api_rate_limit = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] auth_strategy = keystone {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_availability_zone = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_host = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_name = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_stats_polling_interval = 60 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backup_api_class = cinder.backup.api.API {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backup_name_template = backup-%s {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backup_use_same_host = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backup_use_temp_snapshot = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] chap_password = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] chap_username = {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cinder_internal_tenant_project_id = d2dc0e788a5e4457857d6a23692e843a {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cinder_internal_tenant_user_id = b111b7224bba4f1880efcd0cac3135da {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cluster = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] compression_format = gzip {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] compute_api_class = cinder.compute.nova.API {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] config_dir = [] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] config_source = [] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] control_exchange = openstack {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] debug = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] default_availability_zone = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] default_group_type = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] default_volume_type = QuobyteHD {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] disk_geometry = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] driver_client_cert = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] driver_client_cert_key = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] driver_data_namespace = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] driver_ssl_cert_path = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] driver_ssl_cert_verify = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] driver_use_ssl = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] enable_new_services = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] enable_unsupported_driver = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] enabled_backends = ['QuobyteHD'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] enforce_multipath_for_image_xfer = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] filter_function = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] glance_api_insecure = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] glance_api_servers = ['http://192.168.122.102/image'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] glance_api_ssl_compression = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] glance_ca_certificates_file = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] glance_catalog_info = image:glance:publicURL {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] glance_certfile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] glance_keyfile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] glance_num_retries = 3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] glance_request_timeout = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] goodness_function = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] graceful_shutdown_timeout = 5 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] group_api_class = cinder.group.api.API {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] host = devstack {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] image_compress_on_upload = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] image_conversion_address_space_limit = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] image_conversion_cpu_limit = 60 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] image_conversion_disable = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] image_upload_use_cinder_backend = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] image_upload_use_internal_tenant = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] image_volume_cache_enabled = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] image_volume_cache_max_count = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] image_volume_cache_max_size_gb = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] init_host_max_objects_retrieval = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] instance_format = [instance: %(uuid)s] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] iscsi_target_flags = {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] iscsi_write_cache = on {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] iser_helper = tgtadm {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] iser_ip_address = 192.168.122.102 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] iser_port = 3260 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86818]: INFO cinder.volume.manager [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Starting volume driver QuobyteDriver (1.2) Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86818]: DEBUG cinder.volume.drivers.remotefs [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86818) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] log_color = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] log_config_append = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] log_dir = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] log_file = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] log_options = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] log_rotate_interval = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] log_rotate_interval_type = days {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] log_rotation_type = none {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] max_age = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] max_logfile_count = 30 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] max_logfile_size_mb = 200 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] max_over_subscription_ratio = 20.0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] message_reap_interval = 86400 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] message_ttl = 2592000 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] migration_create_volume_timeout_secs = 300 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] monkey_patch = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] monkey_patch_modules = [] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] my_ip = 192.168.122.102 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] no_snapshot_gb_quota = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] num_iser_scan_tries = 3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] num_shell_tries = 3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] num_volume_device_scan_tries = 3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] nvmeof_conn_info_version = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] nvmet_ns_id = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] nvmet_port_id = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] osapi_max_limit = 1000 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] osapi_volume_ext_list = [] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] osapi_volume_listen = 0.0.0.0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] osapi_volume_listen_port = 8776 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] osapi_volume_use_ssl = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] osapi_volume_workers = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] per_volume_size_limit = -1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] periodic_fuzzy_delay = 60 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] periodic_interval = 60 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] project_id_regex = [0-9a-f\-]+ {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] public_endpoint = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] publish_errors = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] quota_backup_gigabytes = 1000 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] quota_backups = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] quota_gigabytes = 1000 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] quota_groups = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] quota_snapshots = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] quota_volumes = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] rate_limit_burst = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] rate_limit_except_level = CRITICAL {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] rate_limit_interval = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] reinit_driver_count = 3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] replication_device = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] report_discard_supported = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] report_interval = 120 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] reservation_clean_interval = 86400 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] reservation_expire = 86400 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] reserved_image_namespaces = [] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] reserved_percentage = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] rpc_response_timeout = 120 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] run_external_periodic_tasks = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] scst_target_driver = iscsi {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] scst_target_iqn_name = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] service_down_time = 720 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] shell_completion = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] snapshot_name_template = snapshot-%s {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] split_loggers = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] state_path = /opt/stack/data/cinder {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] storage_availability_zone = nova {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] storage_protocol = iSCSI {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] syslog_log_facility = LOG_USER {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] target_helper = lioadm {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] target_ip_address = 192.168.122.102 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] target_port = 3260 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] target_protocol = iscsi {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] target_secondary_ip_addresses = [] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] trace_flags = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] transfer_api_class = cinder.transfer.api.API {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] transport_url = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] until_refresh = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] use_chap_auth = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] use_default_quota_class = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] use_journal = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] use_json = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] use_multipath_for_image_xfer = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] use_stderr = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] use_syslog = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] verify_glance_signatures = enabled {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] volume_api_class = cinder.volume.api.API {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] volume_backend_name = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] volume_clear = zero {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] volume_clear_ionice = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] volume_clear_size = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] volume_copy_bps_limit = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] volume_dd_blocksize = 1M {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] volume_name_template = volume-%s {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] volume_service_inithost_offload = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] volume_usage_audit_period = month {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] zoning_mode = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_concurrency.disable_process_locking = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.auth_section = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.auth_type = password {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.auth_version = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.cache = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.certfile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.delay_auth_decision = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.http_connect_timeout = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.include_service_catalog = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.insecure = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.interface = public {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.keyfile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.memcache_password = {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.memcache_username = {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.region_name = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.service_token_roles_required = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.service_type = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.token_cache_time = 300 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.102/identity {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.backend = dogpile.cache.null {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.backend_argument = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.backend_expiration_time = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.config_prefix = cache.oslo {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.debug_cache_backend = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.enable_retry_client = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.enable_socket_keepalive = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.enabled = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.expiration_time = 600 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.hashclient_retry_attempts = 2 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86818]: DEBUG cinder.volume.drivers.quobyte [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86818) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 22 12:07:16 devstack cinder-volume[86818]: WARNING cinder.volume.drivers.quobyte [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.memcache_dead_retry = 300 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86818]: WARNING cinder.volume.drivers.quobyte [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.memcache_pool_maxsize = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.memcache_sasl_enabled = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.password = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.proxies = [] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.redis_db = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.redis_sentinel_service_name = mymaster {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.redis_server = localhost:6379 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86818]: DEBUG oslo_concurrency.processutils [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Running cmd (subprocess): mount.quobyte {{(pid=86818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.retry_attempts = 2 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.retry_delay = 0.0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.socket_keepalive_count = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.socket_keepalive_idle = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.socket_keepalive_interval = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.socket_timeout = 1.0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.tls_allowed_ciphers = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.tls_cafile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.tls_certfile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.tls_enabled = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.tls_keyfile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cache.username = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] coordination.backend_url = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.asyncio_connection = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.asyncio_slave_connection = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.backend = sqlalchemy {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.connection = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.connection_debug = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.connection_parameters = {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.connection_recycle_time = 3600 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.connection_trace = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.db_inc_retry_interval = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.db_max_retries = 20 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.db_max_retry_interval = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.db_retry_interval = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.max_overflow = 50 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.max_pool_size = 5 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.max_retries = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.mysql_wsrep_sync_wait = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.pool_timeout = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.retry_interval = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.slave_connection = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.sqlite_synchronous = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.synchronous_reader = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] database.use_db_reconnect = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] profiler.connection_string = messaging:// {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] profiler.enabled = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] profiler.es_doc_type = notification {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] profiler.es_scroll_size = 10000 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] profiler.es_scroll_time = 2m {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] profiler.filter_error_trace = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] profiler.hmac_keys = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] profiler.sentinel_service_name = mymaster {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] profiler.socket_timeout = 0.1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] profiler.trace_requests = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] profiler.trace_sqlalchemy = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] profiler_jaeger.process_tags = {} {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] profiler_jaeger.service_name_prefix = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] profiler_otlp.service_name_prefix = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_policy.enforce_new_defaults = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_policy.policy_default_rule = default {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_policy.policy_file = policy.yaml {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_policy.remote_timeout = 60.0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] privsep_osbrick.group = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] privsep_osbrick.helper_command = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] privsep_osbrick.user = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cinder_sys_admin.group = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cinder_sys_admin.helper_command = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] cinder_sys_admin.user = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] service_user.auth_section = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] service_user.auth_type = password {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] service_user.cafile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] service_user.certfile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] service_user.collect_timing = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] service_user.insecure = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] service_user.keyfile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] service_user.send_service_user_token = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] service_user.split_loggers = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] service_user.timeout = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] glance.auth_section = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] glance.auth_type = password {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] glance.certfile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] glance.collect_timing = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] glance.insecure = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] glance.keyfile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] glance.region_name = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] glance.split_loggers = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] glance.timeout = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.backend_availability_zone = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.chap_password = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.chap_username = {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.disk_geometry = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.driver_client_cert = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.driver_client_cert_key = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.driver_data_namespace = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.driver_use_ssl = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.enable_unsupported_driver = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.extra_capabilities = {} {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.filter_function = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.goodness_function = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.iscsi_target_flags = {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.iscsi_write_cache = on {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.iser_helper = tgtadm {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.iser_ip_address = 192.168.122.102 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.iser_port = 3260 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.nas_host = {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.nas_login = admin {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.nas_mount_options = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.nas_password = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.nas_private_key = {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.nas_share_path = {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.nas_ssh_port = 22 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.num_shell_tries = 3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.nvmet_port_id = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.quobyte_client_cfg = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.quobyte_volume_url = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.replication_device = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.report_discard_supported = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.reserved_percentage = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.scst_target_driver = iscsi {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.scst_target_iqn_name = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.storage_protocol = iSCSI {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.target_helper = tgtadm {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.target_ip_address = 192.168.122.102 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.target_port = 3260 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.target_protocol = iscsi {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.trace_flags = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.unique_fqdn_network = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.use_chap_auth = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.volume_backend_name = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.volume_clear = zero {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.volume_clear_ionice = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.volume_clear_size = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_reports.file_event_handler = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_reports.log_dir = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.backend_availability_zone = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.backend_host = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.chap_password = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.chap_username = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.chiscsi_conf = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.disk_geometry = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.driver_client_cert = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.driver_client_cert_key = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.driver_data_namespace = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.driver_use_ssl = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.extra_capabilities = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.filter_function = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.goodness_function = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack quobyte-client[86819]: Reading configuration file: /etc/quobyte/client.cfg Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.iscsi_target_flags = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.iscsi_write_cache = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.iser_helper = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack quobyte-client[86819]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.iser_ip_address = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.iser_port = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.iser_target_prefix = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.nas_host = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.nas_login = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.nas_mount_options = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.nas_password = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.nas_private_key = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.nas_share_path = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.nas_ssh_port = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.num_shell_tries = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.nvmet_ns_id = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.nvmet_port_id = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.replication_device = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.report_discard_supported = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.reserved_percentage = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.scst_target_driver = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.storage_protocol = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.target_helper = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.target_ip_address = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.target_port = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.target_prefix = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.target_protocol = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.trace_flags = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.unique_fqdn_network = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.use_chap_auth = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.volume_clear = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.volume_clear_ionice = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.volume_clear_size = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] QuobyteHD.volumes_dir = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86818]: DEBUG oslo_concurrency.processutils [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] CMD "mount.quobyte" returned: 1 in 0.152s {{(pid=86818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86818]: DEBUG oslo_concurrency.lockutils [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86818]: DEBUG oslo_concurrency.lockutils [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:07:16 devstack sudo[86824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 -c /etc/quobyte/client-cinder.cfg Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:07:16 devstack cinder-volume[86818]: DEBUG cinder.volume.drivers.quobyte [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=86818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86818]: INFO cinder.volume.drivers.quobyte [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 ... Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86818]: DEBUG oslo_concurrency.processutils [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 -c /etc/quobyte/client-cinder.cfg {{(pid=86818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.ssl = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.ssl_version = {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_notifications.driver = [] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_notifications.retry = -1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] oslo_messaging_notifications.transport_url = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] key_manager.fixed_key = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican.barbican_api_version = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican.barbican_endpoint = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican.barbican_endpoint_type = public {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican.barbican_region_name = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican.cafile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican.certfile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican.collect_timing = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican.insecure = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican.keyfile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican.number_of_retries = 60 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican.retry_delay = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican.send_service_user_token = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican.split_loggers = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican.timeout = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican.verify_ssl = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican.verify_ssl_path = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican_service_user.auth_section = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican_service_user.auth_type = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican_service_user.cafile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican_service_user.certfile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican_service_user.collect_timing = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican_service_user.insecure = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican_service_user.keyfile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican_service_user.split_loggers = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] barbican_service_user.timeout = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] vault.approle_role_id = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] vault.approle_secret_id = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] vault.auth_method = approle {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] vault.auth_path = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] vault.kv_mountpoint = secret {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] vault.kv_path = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] vault.kv_version = 2 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] vault.namespace = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] vault.root_token_id = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] vault.ssl_ca_crt_file = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] vault.timeout = 60.0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] vault.token_file = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] vault.token_role = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] vault.use_ssl = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:16 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] ******************************************************************************** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 22 12:07:17 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG oslo_concurrency.processutils [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.372s {{(pid=86818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:07:17 devstack cinder-volume[86818]: INFO cinder.volume.drivers.quobyte [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 succeeded Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG cinder.volume.drivers.quobyte [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=86818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG oslo_concurrency.lockutils [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.383s {{(pid=86818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG oslo_concurrency.processutils [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=86818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:07:17 devstack sudo[86901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:07:17 devstack sudo[86901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:07:17 devstack sudo[86901]: pam_unix(sudo:session): session closed for user root Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG oslo_concurrency.processutils [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.274s {{(pid=86818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:07:17 devstack cinder-volume[86818]: INFO cinder.volume.driver [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Driver hasn't implemented _init_vendor_properties() Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG cinder.volume.driver [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6803550720215, 'free_capacity_gb': 1775.6803550720215, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86818) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG oslo_db.sqlalchemy.engines [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86818) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG dbcounter [-] [86818] Writer thread running {{(pid=86818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG cinder.db.api [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Building query based on filter {{(pid=86818) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG cinder.image.image_utils [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86818) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 22 12:07:17 devstack cinder-volume[86818]: INFO cinder.keymgr.migration [None req-82871627-f71f-41cb-9566-81476c0187ea None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG oslo_concurrency.lockutils [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG oslo_concurrency.lockutils [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG cinder.volume.drivers.quobyte [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=86818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG cinder.volume.drivers.quobyte [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=86818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG oslo_concurrency.lockutils [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG oslo_concurrency.processutils [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=86818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:07:17 devstack sudo[86913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:07:17 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:07:17 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG oslo_concurrency.processutils [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.243s {{(pid=86818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG cinder.manager [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Notifying Schedulers of capabilities ... {{(pid=86818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:07:17 devstack cinder-volume[86818]: INFO cinder.volume.manager [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Driver initialization completed successfully. Jul 22 12:07:17 devstack cinder-volume[86818]: INFO cinder.manager [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Initiating service 3 cleanup Jul 22 12:07:17 devstack cinder-volume[86818]: INFO cinder.manager [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Service 3 cleanup completed. Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG cinder.service [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Creating RPC server for service cinder-volume {{(pid=86818) start /opt/stack/cinder/cinder/service.py:231}} Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG cinder.service [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86818) start /opt/stack/cinder/cinder/service.py:237}} Jul 22 12:07:17 devstack cinder-volume[86818]: INFO cinder.volume.manager [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG oslo_concurrency.lockutils [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG oslo_concurrency.lockutils [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG cinder.volume.drivers.quobyte [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=86818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG cinder.volume.drivers.quobyte [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=86818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG oslo_concurrency.lockutils [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:07:17 devstack cinder-volume[86818]: DEBUG oslo_concurrency.processutils [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=86818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:07:17 devstack sudo[86924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:07:17 devstack sudo[86924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:07:18 devstack sudo[86924]: pam_unix(sudo:session): session closed for user root Jul 22 12:07:18 devstack cinder-volume[86818]: DEBUG oslo_concurrency.processutils [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.297s {{(pid=86818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:07:18 devstack cinder-volume[86818]: INFO cinder.volume.manager [None req-fb5ab8de-6a53-408f-9a44-69a3d93d439c None None] Driver post RPC initialization completed successfully. Jul 22 12:07:23 devstack cinder-volume[86818]: DEBUG oslo_concurrency.lockutils [None req-c0811c57-e832-4812-93fe-b5c63f167d09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:07:23 devstack cinder-volume[86818]: DEBUG oslo_concurrency.lockutils [None req-c0811c57-e832-4812-93fe-b5c63f167d09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:07:23 devstack cinder-volume[86818]: DEBUG cinder.volume.drivers.quobyte [None req-c0811c57-e832-4812-93fe-b5c63f167d09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=86818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:07:23 devstack cinder-volume[86818]: DEBUG cinder.volume.drivers.quobyte [None req-c0811c57-e832-4812-93fe-b5c63f167d09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=86818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:07:23 devstack cinder-volume[86818]: DEBUG oslo_concurrency.lockutils [None req-c0811c57-e832-4812-93fe-b5c63f167d09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:07:23 devstack cinder-volume[86818]: DEBUG oslo_concurrency.processutils [None req-c0811c57-e832-4812-93fe-b5c63f167d09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=86818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:07:23 devstack sudo[87124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:07:23 devstack sudo[87124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:07:23 devstack sudo[87124]: pam_unix(sudo:session): session closed for user root Jul 22 12:07:23 devstack cinder-volume[86818]: DEBUG oslo_concurrency.processutils [None req-c0811c57-e832-4812-93fe-b5c63f167d09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.237s {{(pid=86818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:07:23 devstack cinder-volume[86818]: DEBUG cinder.manager [None req-c0811c57-e832-4812-93fe-b5c63f167d09 None None] Notifying Schedulers of capabilities ... {{(pid=86818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:07:26 devstack cinder-volume[86599]: DEBUG dbcounter [-] [86599] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86599) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:07:26 devstack cinder-volume[86599]: INFO oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Caught SIGTERM, stopping children Jul 22 12:07:26 devstack cinder-volume[86599]: DEBUG oslo_concurrency.lockutils [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Acquiring lock "singleton_lock" {{(pid=86599) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 12:07:26 devstack cinder-volume[86599]: DEBUG oslo_concurrency.lockutils [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Acquired lock "singleton_lock" {{(pid=86599) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 12:07:26 devstack cinder-volume[86599]: DEBUG oslo_concurrency.lockutils [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Releasing lock "singleton_lock" {{(pid=86599) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 12:07:26 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Stop services. {{(pid=86599) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 22 12:07:26 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Killing children. {{(pid=86599) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 22 12:07:26 devstack cinder-volume[86599]: INFO oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Waiting on 1 children to exit Jul 22 12:07:27 devstack cinder-volume[86818]: DEBUG dbcounter [-] [86818] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:07:28 devstack cinder-volume[86818]: DEBUG dbcounter [-] [86818] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:07:31 devstack cinder-volume[86818]: DEBUG oslo_concurrency.lockutils [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Acquiring lock "singleton_lock" {{(pid=86818) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 12:07:31 devstack cinder-volume[86818]: DEBUG oslo_concurrency.lockutils [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Acquired lock "singleton_lock" {{(pid=86818) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 12:07:31 devstack cinder-volume[86818]: DEBUG oslo_concurrency.lockutils [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Releasing lock "singleton_lock" {{(pid=86818) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 12:07:31 devstack cinder-volume[86818]: WARNING amqp [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 22 12:07:31 devstack cinder-volume[86818]: WARNING amqp [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 22 12:07:31 devstack cinder-volume[86599]: INFO oslo_service.backend._eventlet.service [None req-2f21a3b0-483d-4324-9625-cff4dd9be3db None None] Child 86818 exited with status 0 Jul 22 12:07:31 devstack cinder-volume[87318]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 22 12:07:31 devstack cinder-volume[87318]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 22 12:07:31 devstack cinder-volume[87318]: we strongly recommend against using it for new projects. Jul 22 12:07:31 devstack cinder-volume[87318]: If you are already using Eventlet, we recommend migrating to a different Jul 22 12:07:31 devstack cinder-volume[87318]: framework. For more detail see Jul 22 12:07:31 devstack cinder-volume[87318]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 22 12:07:31 devstack cinder-volume[87318]: import eventlet # noqa Jul 22 12:07:34 devstack cinder-volume[87318]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 12:07:34 devstack cinder-volume[87318]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 12:07:34 devstack cinder-volume[87318]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 12:07:35 devstack cinder-volume[87318]: INFO dbcounter [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] Registered counter for database cinder Jul 22 12:07:35 devstack cinder-volume[87318]: DEBUG oslo_db.sqlalchemy.engines [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 12:07:35 devstack cinder-volume[87318]: DEBUG dbcounter [-] [87318] Writer thread running {{(pid=87318) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 12:07:35 devstack cinder-volume[87318]: INFO cinder.rpc [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 22 12:07:35 devstack cinder-volume[87318]: INFO cinder.rpc [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_db.sqlalchemy.engines [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 12:07:36 devstack cinder-volume[87318]: INFO cinder.volume.manager [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] Determined volume DB was empty at startup. Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG cinder.volume.manager [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87318) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 22 12:07:36 devstack cinder-volume[87318]: WARNING stevedore.named [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 22 12:07:36 devstack cinder-volume[87318]: WARNING castellan.key_manager [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 12:07:36 devstack cinder-volume[87318]: WARNING cinder.keymgr.conf_key_mgr [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 12:07:36 devstack cinder-volume[87318]: INFO cinder.volume.manager [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_db.sqlalchemy.engines [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 12:07:36 devstack cinder-volume[87318]: INFO oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] Starting 1 workers Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] Started child 87568 {{(pid=87318) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] Full set of CONF: {{(pid=87318) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] ******************************************************************************** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] Configuration options gathered from: {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] ================================================================================ {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] allow_availability_zone_fallback = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] allow_compression_on_image_upload = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] allowed_direct_url_schemes = [] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] api_rate_limit = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] auth_strategy = keystone {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_availability_zone = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_host = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_name = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_stats_polling_interval = 60 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backup_api_class = cinder.backup.api.API {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backup_name_template = backup-%s {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backup_use_same_host = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backup_use_temp_snapshot = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87568]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] chap_password = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] chap_username = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cinder_internal_tenant_project_id = d2dc0e788a5e4457857d6a23692e843a {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cinder_internal_tenant_user_id = b111b7224bba4f1880efcd0cac3135da {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cluster = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] compression_format = gzip {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] compute_api_class = cinder.compute.nova.API {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] config_dir = [] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] config_source = [] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] control_exchange = openstack {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] debug = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] default_availability_zone = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] default_group_type = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] default_volume_type = QuobyteHD {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] disk_geometry = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] driver_client_cert = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] driver_client_cert_key = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] driver_data_namespace = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] driver_ssl_cert_path = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] driver_ssl_cert_verify = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] driver_use_ssl = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] enable_new_services = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] enable_unsupported_driver = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] enabled_backends = ['QuobyteHD'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] enforce_multipath_for_image_xfer = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] filter_function = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] glance_api_insecure = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] glance_api_servers = ['http://192.168.122.102/image'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] glance_api_ssl_compression = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] glance_ca_certificates_file = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] glance_catalog_info = image:glance:publicURL {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] glance_certfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] glance_keyfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] glance_num_retries = 3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] glance_request_timeout = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] goodness_function = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] graceful_shutdown_timeout = 5 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] group_api_class = cinder.group.api.API {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] host = devstack {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] image_compress_on_upload = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] image_conversion_address_space_limit = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] image_conversion_cpu_limit = 60 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] image_conversion_disable = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] image_upload_use_cinder_backend = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] image_upload_use_internal_tenant = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] image_volume_cache_enabled = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] image_volume_cache_max_count = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] image_volume_cache_max_size_gb = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] init_host_max_objects_retrieval = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] instance_format = [instance: %(uuid)s] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] iscsi_target_flags = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] iscsi_write_cache = on {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] iser_helper = tgtadm {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] iser_ip_address = 192.168.122.102 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] iser_port = 3260 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] log_color = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] log_config_append = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] log_dir = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] log_file = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] log_options = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] log_rotate_interval = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] log_rotate_interval_type = days {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] log_rotation_type = none {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] max_age = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] max_logfile_count = 30 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] max_logfile_size_mb = 200 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] max_over_subscription_ratio = 20.0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Starting volume driver QuobyteDriver (1.2) Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] message_reap_interval = 86400 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87568) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] message_ttl = 2592000 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] migration_create_volume_timeout_secs = 300 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] monkey_patch = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] monkey_patch_modules = [] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] my_ip = 192.168.122.102 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] no_snapshot_gb_quota = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] num_iser_scan_tries = 3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] num_shell_tries = 3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] num_volume_device_scan_tries = 3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] nvmeof_conn_info_version = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] nvmet_ns_id = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] nvmet_port_id = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] osapi_max_limit = 1000 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] osapi_volume_ext_list = [] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] osapi_volume_listen_port = 8776 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] osapi_volume_use_ssl = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] osapi_volume_workers = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] per_volume_size_limit = -1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] periodic_fuzzy_delay = 60 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] periodic_interval = 60 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] public_endpoint = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] publish_errors = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] quota_backup_gigabytes = 1000 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] quota_backups = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] quota_gigabytes = 1000 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] quota_groups = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] quota_snapshots = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] quota_volumes = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] rate_limit_burst = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] rate_limit_except_level = CRITICAL {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] rate_limit_interval = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] reinit_driver_count = 3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] replication_device = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] report_discard_supported = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] report_interval = 120 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] reservation_clean_interval = 86400 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] reservation_expire = 86400 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] reserved_image_namespaces = [] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] reserved_percentage = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] rpc_response_timeout = 120 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] run_external_periodic_tasks = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] scst_target_driver = iscsi {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] scst_target_iqn_name = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] service_down_time = 720 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] shell_completion = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] snapshot_name_template = snapshot-%s {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] split_loggers = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] state_path = /opt/stack/data/cinder {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] storage_availability_zone = nova {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] storage_protocol = iSCSI {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] syslog_log_facility = LOG_USER {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] target_helper = lioadm {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] target_ip_address = 192.168.122.102 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] target_port = 3260 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] target_protocol = iscsi {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] target_secondary_ip_addresses = [] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] trace_flags = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] transport_url = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] until_refresh = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] use_chap_auth = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] use_default_quota_class = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] use_journal = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] use_json = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] use_multipath_for_image_xfer = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] use_stderr = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] use_syslog = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] verify_glance_signatures = enabled {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] volume_api_class = cinder.volume.api.API {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] volume_backend_name = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] volume_clear = zero {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] volume_clear_ionice = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] volume_clear_size = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] volume_copy_bps_limit = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] volume_dd_blocksize = 1M {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] volume_name_template = volume-%s {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] volume_service_inithost_offload = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] volume_usage_audit_period = month {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] zoning_mode = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_concurrency.disable_process_locking = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.auth_section = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.auth_type = password {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.auth_version = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.cache = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.certfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.include_service_catalog = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.insecure = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.interface = public {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.keyfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.memcache_password = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.memcache_username = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.region_name = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.service_type = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.102/identity {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.backend = dogpile.cache.null {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.backend_argument = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.backend_expiration_time = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.config_prefix = cache.oslo {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.debug_cache_backend = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.enable_retry_client = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.enable_socket_keepalive = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.enabled = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.expiration_time = 600 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.hashclient_retry_attempts = 2 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.memcache_dead_retry = 300 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.memcache_pool_maxsize = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.memcache_sasl_enabled = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.password = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.proxies = [] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.redis_db = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.redis_server = localhost:6379 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.retry_attempts = 2 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.retry_delay = 0.0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.socket_keepalive_count = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.socket_keepalive_idle = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.socket_keepalive_interval = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.socket_timeout = 1.0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.tls_allowed_ciphers = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.tls_cafile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.tls_certfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.tls_enabled = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.tls_keyfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cache.username = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] coordination.backend_url = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.asyncio_connection = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87568) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 22 12:07:36 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.quobyte [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 22 12:07:36 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.quobyte [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.asyncio_slave_connection = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.backend = sqlalchemy {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.connection = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.connection_debug = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Running cmd (subprocess): mount.quobyte {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.connection_parameters = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.connection_recycle_time = 3600 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.connection_trace = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.db_inc_retry_interval = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.db_max_retries = 20 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.db_max_retry_interval = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.db_retry_interval = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.max_overflow = 50 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.max_pool_size = 5 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.max_retries = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.mysql_wsrep_sync_wait = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.pool_timeout = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.retry_interval = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.slave_connection = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.sqlite_synchronous = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.synchronous_reader = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] database.use_db_reconnect = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] profiler.connection_string = messaging:// {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] profiler.enabled = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] profiler.es_doc_type = notification {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] profiler.es_scroll_size = 10000 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] profiler.es_scroll_time = 2m {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] profiler.filter_error_trace = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] profiler.hmac_keys = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] profiler.sentinel_service_name = mymaster {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] profiler.socket_timeout = 0.1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] profiler.trace_requests = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] profiler.trace_sqlalchemy = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] profiler_jaeger.process_tags = {} {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] profiler_jaeger.service_name_prefix = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] profiler_otlp.service_name_prefix = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_policy.enforce_new_defaults = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_policy.policy_default_rule = default {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_policy.policy_file = policy.yaml {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] privsep_osbrick.group = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] privsep_osbrick.helper_command = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] privsep_osbrick.user = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cinder_sys_admin.group = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cinder_sys_admin.helper_command = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] cinder_sys_admin.user = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] service_user.auth_section = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] service_user.auth_type = password {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] service_user.cafile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] service_user.certfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] service_user.collect_timing = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] service_user.insecure = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] service_user.keyfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] service_user.send_service_user_token = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] service_user.split_loggers = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] service_user.timeout = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] glance.auth_section = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] glance.auth_type = password {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] glance.certfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] glance.collect_timing = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] glance.insecure = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] glance.keyfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] glance.region_name = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] glance.split_loggers = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] glance.timeout = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.backend_availability_zone = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.chap_password = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.chap_username = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.disk_geometry = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.driver_client_cert = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.driver_client_cert_key = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.driver_data_namespace = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.driver_use_ssl = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.extra_capabilities = {} {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.filter_function = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.goodness_function = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.iscsi_target_flags = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.iscsi_write_cache = on {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.iser_helper = tgtadm {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.iser_ip_address = 192.168.122.102 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.iser_port = 3260 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.nas_host = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.nas_login = admin {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.nas_mount_options = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.nas_password = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.nas_private_key = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.nas_share_path = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.num_shell_tries = 3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.quobyte_volume_url = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.replication_device = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.report_discard_supported = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.reserved_percentage = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.target_helper = tgtadm {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.target_ip_address = 192.168.122.102 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.target_port = 3260 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack quobyte-client[87569]: Reading configuration file: /etc/quobyte/client.cfg Jul 22 12:07:36 devstack quobyte-client[87569]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.target_protocol = iscsi {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.trace_flags = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.unique_fqdn_network = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.use_chap_auth = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.volume_backend_name = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.volume_clear = zero {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.volume_clear_ionice = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.volume_clear_size = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_reports.file_event_handler = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_reports.log_dir = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.backend_availability_zone = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.backend_host = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.chap_password = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.chap_username = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.chiscsi_conf = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.disk_geometry = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.driver_client_cert = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.driver_data_namespace = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.driver_use_ssl = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.extra_capabilities = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.filter_function = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.goodness_function = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.iser_helper = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.iser_ip_address = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.iser_port = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.iser_target_prefix = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.nas_host = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.nas_login = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.nas_mount_options = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.nas_password = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.nas_private_key = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.nas_share_path = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.nas_ssh_port = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.num_shell_tries = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.nvmet_port_id = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.replication_device = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.report_discard_supported = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.reserved_percentage = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.scst_target_driver = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.storage_protocol = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.target_helper = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.target_ip_address = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.target_port = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.target_prefix = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.target_protocol = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.trace_flags = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.use_chap_auth = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.volume_clear = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.volume_clear_size = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] QuobyteHD.volumes_dir = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.ssl = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_notifications.driver = [] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack sudo[87570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_notifications.retry = -1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack sudo[87570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] key_manager.fixed_key = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican.barbican_api_version = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican.barbican_endpoint = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican.barbican_endpoint_type = public {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican.barbican_region_name = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican.cafile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican.certfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican.collect_timing = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican.insecure = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican.keyfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican.number_of_retries = 60 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican.retry_delay = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican.send_service_user_token = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican.split_loggers = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican.timeout = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican.verify_ssl = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican.verify_ssl_path = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican_service_user.auth_section = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican_service_user.auth_type = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican_service_user.cafile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican_service_user.certfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican_service_user.collect_timing = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican_service_user.insecure = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican_service_user.keyfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican_service_user.split_loggers = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] barbican_service_user.timeout = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] vault.approle_role_id = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] vault.approle_secret_id = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] vault.auth_method = approle {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] vault.auth_path = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] vault.kv_mountpoint = secret {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] vault.kv_path = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] vault.kv_version = 2 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] vault.namespace = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] vault.root_token_id = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] vault.ssl_ca_crt_file = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] vault.timeout = 60.0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] vault.token_file = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] vault.token_role = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] vault.use_ssl = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 12:07:36 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-b9ab1b38-5560-4888-877c-4b8b5148a499 None None] ******************************************************************************** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 22 12:07:36 devstack sudo[87570]: pam_unix(sudo:session): session closed for user root Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.235s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:07:36 devstack cinder-volume[87568]: INFO cinder.volume.driver [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Driver hasn't implemented _init_vendor_properties() Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG cinder.volume.driver [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6803550720215, 'free_capacity_gb': 1775.6803550720215, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87568) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG oslo_db.sqlalchemy.engines [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87568) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writer thread running {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG cinder.db.api [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Building query based on filter {{(pid=87568) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87568) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:07:36 devstack cinder-volume[87568]: INFO cinder.keymgr.migration [None req-bcd21451-11da-4eb3-9c37-8f02c8d1981e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 22 12:07:36 devstack sudo[87573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:07:36 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:07:36 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.228s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:07:36 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:07:37 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Driver initialization completed successfully. Jul 22 12:07:37 devstack cinder-volume[87568]: INFO cinder.manager [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Initiating service 3 cleanup Jul 22 12:07:37 devstack cinder-volume[87568]: INFO cinder.manager [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Service 3 cleanup completed. Jul 22 12:07:37 devstack cinder-volume[87568]: DEBUG cinder.service [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Creating RPC server for service cinder-volume {{(pid=87568) start /opt/stack/cinder/cinder/service.py:231}} Jul 22 12:07:37 devstack cinder-volume[87568]: DEBUG cinder.service [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87568) start /opt/stack/cinder/cinder/service.py:237}} Jul 22 12:07:37 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 22 12:07:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:07:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:07:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:07:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:07:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:07:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:07:37 devstack sudo[87606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:07:37 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:07:37 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root Jul 22 12:07:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.245s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:07:37 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-7408018e-48dc-48f1-b7aa-49ad5b6cf9f7 None None] Driver post RPC initialization completed successfully. Jul 22 12:07:46 devstack cinder-volume[87318]: DEBUG dbcounter [-] [87318] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87318) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:07:47 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=2 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:07:47 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:08:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:08:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread count: 6 {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:08:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread info: [<_MainThread(MainThread, started 137793405739136)>, , , , , ] {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:09:07 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:09:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Flow 'volume_create_manager' (a7ddc4de-b0f2-42b8-bc85-dd8743a0d44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:09:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d09a0c-d26c-4157-9fec-6ebf06e0305b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d09a0c-d26c-4157-9fec-6ebf06e0305b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1104132660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb28686-1bb0-4fd5-9f9b-7a0506969eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af84460f930b47e3ae824347a5212133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:09:07Z,use_quota=True,user_id='edccaf0f4d104d3f886599eda7bacb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e326cab9-de4a-4501-9133-c3f674e201ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e326cab9-de4a-4501-9133-c3f674e201ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3277687b-486e-4d8e-885a-7bfad9560372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3277687b-486e-4d8e-885a-7bfad9560372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eb28686-1bb0-4fd5-9f9b-7a0506969eb2', 'volume_name': 'volume-3eb28686-1bb0-4fd5-9f9b-7a0506969eb2', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5118498e-18ad-41e6-a0ce-643ea581c14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5118498e-18ad-41e6-a0ce-643ea581c14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4bba8f-baa1-425b-8b26-8969705c577a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:07 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Volume 3eb28686-1bb0-4fd5-9f9b-7a0506969eb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eb28686-1bb0-4fd5-9f9b-7a0506969eb2', 'volume_size': 1} Jul 22 12:09:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:09:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:09:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1104132660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb28686-1bb0-4fd5-9f9b-7a0506969eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af84460f930b47e3ae824347a5212133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:09:07Z,use_quota=True,user_id='edccaf0f4d104d3f886599eda7bacb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:09:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Creating volume 3eb28686-1bb0-4fd5-9f9b-7a0506969eb2 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:09:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:09:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:09:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:09:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:09:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:09:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:09:07 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:09:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3eb28686-1bb0-4fd5-9f9b-7a0506969eb2 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:09:07 devstack sudo[88286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3eb28686-1bb0-4fd5-9f9b-7a0506969eb2 1073741824 Jul 22 12:09:07 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:09:09 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root Jul 22 12:09:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3eb28686-1bb0-4fd5-9f9b-7a0506969eb2 1073741824" returned: 0 in 1.637s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:09:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3eb28686-1bb0-4fd5-9f9b-7a0506969eb2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:09:09 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3eb28686-1bb0-4fd5-9f9b-7a0506969eb2 Jul 22 12:09:09 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:09:10 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Jul 22 12:09:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3eb28686-1bb0-4fd5-9f9b-7a0506969eb2" returned: 0 in 0.715s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:09:10 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] <== create_volume: return (2582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:09:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.593s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:09:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4bba8f-baa1-425b-8b26-8969705c577a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eb28686-1bb0-4fd5-9f9b-7a0506969eb2', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d8c493d-eebc-4ffd-addc-a58130d5b09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:10 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Volume volume-3eb28686-1bb0-4fd5-9f9b-7a0506969eb2 (3eb28686-1bb0-4fd5-9f9b-7a0506969eb2): created successfully Jul 22 12:09:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d8c493d-eebc-4ffd-addc-a58130d5b09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Flow 'volume_create_manager' (a7ddc4de-b0f2-42b8-bc85-dd8743a0d44f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:09:10 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-a7d27318-765f-4d8d-8934-41cde2d3ff31 tempest-ServerRescueNegativeTestJSON-1109650654 None] Created volume successfully. Jul 22 12:09:14 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:09:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Flow 'volume_create_manager' (4b13d693-fd30-4b60-979e-7b7fbbd592e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:09:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1088871e-3b52-451f-9a77-0bd24c162c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1088871e-3b52-451f-9a77-0bd24c162c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-933002861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fd7072-a9b6-4239-8f6f-387b13c85400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c319d52660487aaa54eda65d1f93f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:09:14Z,use_quota=True,user_id='55a2c9708ac7419e950de3d634c9e035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (518303f3-cfb2-49b2-87fb-587c535a2e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (518303f3-cfb2-49b2-87fb-587c535a2e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5458f43c-c1f4-4e0d-ab11-f6e2a0b7f1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5458f43c-c1f4-4e0d-ab11-f6e2a0b7f1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2fd7072-a9b6-4239-8f6f-387b13c85400', 'volume_name': 'volume-c2fd7072-a9b6-4239-8f6f-387b13c85400', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2539f887-cc45-4191-b369-6cbcf18cc8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2539f887-cc45-4191-b369-6cbcf18cc8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb52ed6e-7c6e-4d54-811d-ebb84d650f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:14 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Volume c2fd7072-a9b6-4239-8f6f-387b13c85400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2fd7072-a9b6-4239-8f6f-387b13c85400', 'volume_size': 1} Jul 22 12:09:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:09:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:09:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-933002861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fd7072-a9b6-4239-8f6f-387b13c85400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c319d52660487aaa54eda65d1f93f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:09:14Z,use_quota=True,user_id='55a2c9708ac7419e950de3d634c9e035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:09:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Creating volume c2fd7072-a9b6-4239-8f6f-387b13c85400 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:09:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:09:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:09:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:09:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:09:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:09:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:09:14 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:09:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fd7072-a9b6-4239-8f6f-387b13c85400 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:09:14 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fd7072-a9b6-4239-8f6f-387b13c85400 1073741824 Jul 22 12:09:14 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:09:15 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Jul 22 12:09:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fd7072-a9b6-4239-8f6f-387b13c85400 1073741824" returned: 0 in 1.229s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:09:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fd7072-a9b6-4239-8f6f-387b13c85400 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:09:15 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fd7072-a9b6-4239-8f6f-387b13c85400 Jul 22 12:09:15 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:09:16 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Jul 22 12:09:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fd7072-a9b6-4239-8f6f-387b13c85400" returned: 0 in 0.513s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:09:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:09:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:09:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb52ed6e-7c6e-4d54-811d-ebb84d650f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2fd7072-a9b6-4239-8f6f-387b13c85400', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a283cc-838c-4f60-8137-169b8f33c017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:16 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Volume volume-c2fd7072-a9b6-4239-8f6f-387b13c85400 (c2fd7072-a9b6-4239-8f6f-387b13c85400): created successfully Jul 22 12:09:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a283cc-838c-4f60-8137-169b8f33c017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Flow 'volume_create_manager' (4b13d693-fd30-4b60-979e-7b7fbbd592e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:09:16 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-bd5d6374-e2cf-493e-9bf3-603619087ad7 tempest-VolumesAdminNegativeTest-507804074 None] Created volume successfully. Jul 22 12:09:18 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] Acquiring lock "cinder-c2fd7072-a9b6-4239-8f6f-387b13c85400-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:09:18 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] Lock "cinder-c2fd7072-a9b6-4239-8f6f-387b13c85400-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:09:18 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] Acquiring lock "cinder-quobyte-c2fd7072-a9b6-4239-8f6f-387b13c85400" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:09:18 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] Lock "cinder-quobyte-c2fd7072-a9b6-4239-8f6f-387b13c85400" acquired by "delete_volume" :: waited 0.027s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:09:18 devstack cinder-volume[87568]: INFO oslo.privsep.daemon [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpflxgi309/privsep.sock'] Jul 22 12:09:18 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpflxgi309/privsep.sock Jul 22 12:09:18 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:09:20 devstack cinder-volume[87568]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 22 12:09:20 devstack cinder-volume[87568]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 22 12:09:20 devstack cinder-volume[87568]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 22 12:09:20 devstack cinder-volume[87568]: WARNING oslo.privsep.daemon [-] privsep log: Jul 22 12:09:20 devstack cinder-volume[87568]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 22 12:09:20 devstack cinder-volume[87568]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 22 12:09:20 devstack cinder-volume[87568]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 22 12:09:20 devstack cinder-volume[87568]: WARNING oslo.privsep.daemon [-] privsep log: Jul 22 12:09:20 devstack cinder-volume[87568]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 22 12:09:21 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Jul 22 12:09:21 devstack cinder-volume[87568]: INFO oslo.privsep.daemon [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] Spawned new privsep daemon via rootwrap Jul 22 12:09:21 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] Accepted privsep connection to /tmp/tmpflxgi309/privsep.sock {{(pid=87568) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 22 12:09:21 devstack cinder-volume[87568]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 22 12:09:21 devstack cinder-volume[87568]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 22 12:09:21 devstack cinder-volume[87568]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 22 12:09:21 devstack cinder-volume[87568]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88798 Jul 22 12:09:21 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c631848-cb7e-4f82-88c3-aca8cdc2cf38]: (2,) {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:09:21 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d29a33-3c54-4818-a9cd-576f5bb35abb]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:09:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fd7072-a9b6-4239-8f6f-387b13c85400 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:09:21 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fd7072-a9b6-4239-8f6f-387b13c85400 Jul 22 12:09:21 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:09:22 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Jul 22 12:09:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fd7072-a9b6-4239-8f6f-387b13c85400" returned: 0 in 0.744s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:09:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fd7072-a9b6-4239-8f6f-387b13c85400 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:09:22 devstack sudo[88834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fd7072-a9b6-4239-8f6f-387b13c85400 Jul 22 12:09:22 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:09:22 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root Jul 22 12:09:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fd7072-a9b6-4239-8f6f-387b13c85400" returned: 0 in 0.404s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:09:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] Lock "cinder-quobyte-c2fd7072-a9b6-4239-8f6f-387b13c85400" released by "delete_volume" :: held 3.956s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:09:22 devstack cinder-volume[87568]: WARNING cinder.quota [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:09:22 devstack cinder-volume[87568]: WARNING cinder.quota [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:09:22 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] Created reservations ['8a2cf2d6-9115-4276-b866-c5b8c0049c01', 'e5324eb3-e8ec-4b7c-a3b1-0c69088fe0ee', '6194b156-af2d-44a3-b752-1fe54b0343e8', '3e78463b-13b7-4505-b7bd-b6ed991f88dd'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:09:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:09:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:09:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:09:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:09:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:09:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:09:23 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:09:23 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:09:23 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Jul 22 12:09:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.650s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:09:23 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:09:23 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] Deleted volume successfully. Jul 22 12:09:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-13680a56-7ad7-491f-a4c2-ae495fe659a1 tempest-VolumesAdminNegativeTest-507804074 None] Lock "cinder-c2fd7072-a9b6-4239-8f6f-387b13c85400-delete_volume" released by "delete_volume" :: held 5.392s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:09:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:09:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:09:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:09:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:09:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:09:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:09:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:09:24 devstack sudo[88848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:09:24 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:09:25 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.636s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread count: 8 {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread info: [<_MainThread(MainThread, started 137793405739136)>, , , , , , , ] {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Flow 'volume_create_manager' (20914769-85a9-4781-92ee-a3d5b61a2292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b06cec-5df3-46cc-ad26-b415544ed497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b06cec-5df3-46cc-ad26-b415544ed497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1330604670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4224f895-a578-4aa0-911c-154d76d67b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef62ec7fb1c45fca10ed7254998c242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:09:25Z,use_quota=True,user_id='4cb065e8dbdc4028be30dd6ebf1d817d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2e26a1-128a-453a-a1ca-5043f6624ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2e26a1-128a-453a-a1ca-5043f6624ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8781dd4-8d8b-4e9a-bd40-e977cf4cdcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8781dd4-8d8b-4e9a-bd40-e977cf4cdcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4224f895-a578-4aa0-911c-154d76d67b6f', 'volume_name': 'volume-4224f895-a578-4aa0-911c-154d76d67b6f', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b597e34-9c8d-4b3b-bcb4-9c15905493dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b597e34-9c8d-4b3b-bcb4-9c15905493dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e24120-17d6-45f8-a24b-efc321c0c8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:25 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Volume 4224f895-a578-4aa0-911c-154d76d67b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4224f895-a578-4aa0-911c-154d76d67b6f', 'volume_size': 1} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1330604670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4224f895-a578-4aa0-911c-154d76d67b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef62ec7fb1c45fca10ed7254998c242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:09:25Z,use_quota=True,user_id='4cb065e8dbdc4028be30dd6ebf1d817d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Creating volume 4224f895-a578-4aa0-911c-154d76d67b6f {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:09:25 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4224f895-a578-4aa0-911c-154d76d67b6f 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:09:25 devstack sudo[88867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4224f895-a578-4aa0-911c-154d76d67b6f 1073741824 Jul 22 12:09:25 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9aade12a-bd41-46e1-a76c-4e3691bcf8e2 tempest-ServerRescueNegativeTestJSON-1109650654 None] Acquiring lock "cinder-3eb28686-1bb0-4fd5-9f9b-7a0506969eb2-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9aade12a-bd41-46e1-a76c-4e3691bcf8e2 tempest-ServerRescueNegativeTestJSON-1109650654 None] Lock "cinder-3eb28686-1bb0-4fd5-9f9b-7a0506969eb2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:09:25 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9aade12a-bd41-46e1-a76c-4e3691bcf8e2 tempest-ServerRescueNegativeTestJSON-1109650654 None] Acquiring lock "cinder-quobyte-3eb28686-1bb0-4fd5-9f9b-7a0506969eb2" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:09:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9aade12a-bd41-46e1-a76c-4e3691bcf8e2 tempest-ServerRescueNegativeTestJSON-1109650654 None] Lock "cinder-quobyte-3eb28686-1bb0-4fd5-9f9b-7a0506969eb2" acquired by "delete_volume" :: waited 0.057s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:09:26 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b748741c-0980-4a94-bc6b-dadad13a60e1]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:09:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9aade12a-bd41-46e1-a76c-4e3691bcf8e2 tempest-ServerRescueNegativeTestJSON-1109650654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3eb28686-1bb0-4fd5-9f9b-7a0506969eb2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:09:26 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3eb28686-1bb0-4fd5-9f9b-7a0506969eb2 Jul 22 12:09:26 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:09:26 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root Jul 22 12:09:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4224f895-a578-4aa0-911c-154d76d67b6f 1073741824" returned: 0 in 1.030s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:09:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4224f895-a578-4aa0-911c-154d76d67b6f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:09:26 devstack sudo[88878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4224f895-a578-4aa0-911c-154d76d67b6f Jul 22 12:09:26 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:09:26 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Jul 22 12:09:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9aade12a-bd41-46e1-a76c-4e3691bcf8e2 tempest-ServerRescueNegativeTestJSON-1109650654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3eb28686-1bb0-4fd5-9f9b-7a0506969eb2" returned: 0 in 0.846s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:09:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9aade12a-bd41-46e1-a76c-4e3691bcf8e2 tempest-ServerRescueNegativeTestJSON-1109650654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3eb28686-1bb0-4fd5-9f9b-7a0506969eb2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:09:26 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3eb28686-1bb0-4fd5-9f9b-7a0506969eb2 Jul 22 12:09:26 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:09:27 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root Jul 22 12:09:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4224f895-a578-4aa0-911c-154d76d67b6f" returned: 0 in 0.408s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:09:27 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:09:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:09:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e24120-17d6-45f8-a24b-efc321c0c8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4224f895-a578-4aa0-911c-154d76d67b6f', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d62cd321-419a-4e3a-b8ac-6f96b42ef5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:27 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Volume volume-4224f895-a578-4aa0-911c-154d76d67b6f (4224f895-a578-4aa0-911c-154d76d67b6f): created successfully Jul 22 12:09:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d62cd321-419a-4e3a-b8ac-6f96b42ef5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Flow 'volume_create_manager' (20914769-85a9-4781-92ee-a3d5b61a2292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:09:27 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-80197885-8301-42a2-a805-4f60404319ec tempest-AttachVolumeShelveTestJSON-835995706 None] Created volume successfully. Jul 22 12:09:27 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Jul 22 12:09:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9aade12a-bd41-46e1-a76c-4e3691bcf8e2 tempest-ServerRescueNegativeTestJSON-1109650654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3eb28686-1bb0-4fd5-9f9b-7a0506969eb2" returned: 0 in 0.568s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:09:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9aade12a-bd41-46e1-a76c-4e3691bcf8e2 tempest-ServerRescueNegativeTestJSON-1109650654 None] Lock "cinder-quobyte-3eb28686-1bb0-4fd5-9f9b-7a0506969eb2" released by "delete_volume" :: held 1.502s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:09:27 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-9aade12a-bd41-46e1-a76c-4e3691bcf8e2 tempest-ServerRescueNegativeTestJSON-1109650654 None] Created reservations ['59af505d-4acf-4fc8-a87b-9672d80816e0', '6e682482-bcde-4a9e-a8df-7fa27272fd63', '25191556-4188-4563-b1d6-f0ba8ab1949e', 'e5a3bb61-17fc-4250-aacc-6b5631d282b8'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:09:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9aade12a-bd41-46e1-a76c-4e3691bcf8e2 tempest-ServerRescueNegativeTestJSON-1109650654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:09:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9aade12a-bd41-46e1-a76c-4e3691bcf8e2 tempest-ServerRescueNegativeTestJSON-1109650654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:09:27 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9aade12a-bd41-46e1-a76c-4e3691bcf8e2 tempest-ServerRescueNegativeTestJSON-1109650654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:09:27 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9aade12a-bd41-46e1-a76c-4e3691bcf8e2 tempest-ServerRescueNegativeTestJSON-1109650654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:09:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9aade12a-bd41-46e1-a76c-4e3691bcf8e2 tempest-ServerRescueNegativeTestJSON-1109650654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:09:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9aade12a-bd41-46e1-a76c-4e3691bcf8e2 tempest-ServerRescueNegativeTestJSON-1109650654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:09:27 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:09:27 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:09:28 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Jul 22 12:09:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9aade12a-bd41-46e1-a76c-4e3691bcf8e2 tempest-ServerRescueNegativeTestJSON-1109650654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.507s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:09:28 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-9aade12a-bd41-46e1-a76c-4e3691bcf8e2 tempest-ServerRescueNegativeTestJSON-1109650654 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:09:28 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-9aade12a-bd41-46e1-a76c-4e3691bcf8e2 tempest-ServerRescueNegativeTestJSON-1109650654 None] Deleted volume successfully. Jul 22 12:09:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9aade12a-bd41-46e1-a76c-4e3691bcf8e2 tempest-ServerRescueNegativeTestJSON-1109650654 None] Lock "cinder-3eb28686-1bb0-4fd5-9f9b-7a0506969eb2-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:09:47 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=19,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:09:47 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:UPDATE=23,cinder:SELECT=14,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:09:49 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:09:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Flow 'volume_create_manager' (6551183c-efa5-4b5d-a900-deb23de6b227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:09:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823f58d7-c0f4-450b-8beb-cb472c710958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823f58d7-c0f4-450b-8beb-cb472c710958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1500455572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4b162a-9793-4fc6-909c-34f9cfcb1e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec1d50b0f764f4ea085ee581b66e6cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:09:50Z,use_quota=True,user_id='7bc93078cd894cb69f20cdddcc3299a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb1ead5c-2571-4669-bc1b-a9415548c382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb1ead5c-2571-4669-bc1b-a9415548c382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e563a4e-b709-4f6b-accd-56b523d1051c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e563a4e-b709-4f6b-accd-56b523d1051c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d4b162a-9793-4fc6-909c-34f9cfcb1e04', 'volume_name': 'volume-7d4b162a-9793-4fc6-909c-34f9cfcb1e04', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1bd05f-0635-4286-a9a4-9d0fd08884d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1bd05f-0635-4286-a9a4-9d0fd08884d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cffa80e3-4c1f-40f1-b4a0-98b1a9338aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:49 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Volume 7d4b162a-9793-4fc6-909c-34f9cfcb1e04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d4b162a-9793-4fc6-909c-34f9cfcb1e04', 'volume_size': 1} Jul 22 12:09:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:09:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:09:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1500455572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4b162a-9793-4fc6-909c-34f9cfcb1e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec1d50b0f764f4ea085ee581b66e6cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:09:50Z,use_quota=True,user_id='7bc93078cd894cb69f20cdddcc3299a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:09:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Creating volume 7d4b162a-9793-4fc6-909c-34f9cfcb1e04 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:09:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:09:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:09:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:09:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:09:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:09:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:09:49 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:09:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7d4b162a-9793-4fc6-909c-34f9cfcb1e04 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:09:49 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7d4b162a-9793-4fc6-909c-34f9cfcb1e04 1073741824 Jul 22 12:09:50 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:09:50 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Jul 22 12:09:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7d4b162a-9793-4fc6-909c-34f9cfcb1e04 1073741824" returned: 0 in 0.615s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:09:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7d4b162a-9793-4fc6-909c-34f9cfcb1e04 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:09:50 devstack sudo[89028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7d4b162a-9793-4fc6-909c-34f9cfcb1e04 Jul 22 12:09:50 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:09:50 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root Jul 22 12:09:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7d4b162a-9793-4fc6-909c-34f9cfcb1e04" returned: 0 in 0.306s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:09:50 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:09:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:09:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cffa80e3-4c1f-40f1-b4a0-98b1a9338aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d4b162a-9793-4fc6-909c-34f9cfcb1e04', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc2eec7-77ae-44d4-9d85-3b9e0cc20434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:09:50 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Volume volume-7d4b162a-9793-4fc6-909c-34f9cfcb1e04 (7d4b162a-9793-4fc6-909c-34f9cfcb1e04): created successfully Jul 22 12:09:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc2eec7-77ae-44d4-9d85-3b9e0cc20434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:09:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Flow 'volume_create_manager' (6551183c-efa5-4b5d-a900-deb23de6b227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:09:50 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-6aeb9e75-ab9c-4aeb-af8c-93a8d03373a6 tempest-TaggedAttachmentsTest-1916780798 None] Created volume successfully. Jul 22 12:09:54 devstack cinder-volume[87568]: WARNING py.warnings [req-80de1564-d134-4c6a-870c-25d84b6bc0a6 req-4d675ee5-e96b-4aac-a1ad-724e6b7ca9b1 tempest-AttachVolumeShelveTestJSON-835995706 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 22 12:09:54 devstack cinder-volume[87568]: .first() Jul 22 12:09:54 devstack cinder-volume[87568]: Jul 22 12:09:54 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-80de1564-d134-4c6a-870c-25d84b6bc0a6 req-4d675ee5-e96b-4aac-a1ad-724e6b7ca9b1 tempest-AttachVolumeShelveTestJSON-835995706 None] No connector for attachment 9ac9fbb9-08d3-4f23-bd45-0bb1a0bc5355; skipping storage backend terminate_connection call. {{(pid=87568) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 22 12:09:54 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-80de1564-d134-4c6a-870c-25d84b6bc0a6 req-4d675ee5-e96b-4aac-a1ad-724e6b7ca9b1 tempest-AttachVolumeShelveTestJSON-835995706 None] Deleting attachment 9ac9fbb9-08d3-4f23-bd45-0bb1a0bc5355. {{(pid=87568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 12:10:04 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:10:04 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:10:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:10:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:10:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:10:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:10:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:10:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:10:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:10:24 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:10:24 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:10:24 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Jul 22 12:10:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.580s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:10:25 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:10:35 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:10:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Flow 'volume_create_manager' (fcffdc2f-f720-4d7a-98e0-152057a558c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:10:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2008dc24-5c47-411c-94da-5323dc292615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:10:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2008dc24-5c47-411c-94da-5323dc292615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1775778064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83624f59-02fe-44b4-9deb-ebf7a91f5814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a23239ebf584bc1ae22edea5d38cad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:10:36Z,use_quota=True,user_id='bac8fabe664d49be8530bf7138ce36c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:10:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a443dd73-8537-48c1-ad85-5409e63d38d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:10:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a443dd73-8537-48c1-ad85-5409e63d38d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:10:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03adc05f-6578-4cba-8d6b-d778fd946ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:10:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03adc05f-6578-4cba-8d6b-d778fd946ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83624f59-02fe-44b4-9deb-ebf7a91f5814', 'volume_name': 'volume-83624f59-02fe-44b4-9deb-ebf7a91f5814', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:10:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d748fbcb-9eb7-4b09-bb68-9b86e1af2259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:10:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d748fbcb-9eb7-4b09-bb68-9b86e1af2259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:10:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5feb40f9-21c2-41c3-99f9-c0f4b8328a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:10:35 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Volume 83624f59-02fe-44b4-9deb-ebf7a91f5814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83624f59-02fe-44b4-9deb-ebf7a91f5814', 'volume_size': 1} Jul 22 12:10:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:10:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:10:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1775778064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83624f59-02fe-44b4-9deb-ebf7a91f5814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a23239ebf584bc1ae22edea5d38cad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:10:36Z,use_quota=True,user_id='bac8fabe664d49be8530bf7138ce36c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:10:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Creating volume 83624f59-02fe-44b4-9deb-ebf7a91f5814 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:10:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:10:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:10:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:10:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:10:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:10:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:10:35 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:10:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-83624f59-02fe-44b4-9deb-ebf7a91f5814 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:10:35 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-83624f59-02fe-44b4-9deb-ebf7a91f5814 1073741824 Jul 22 12:10:35 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:10:36 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Jul 22 12:10:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-83624f59-02fe-44b4-9deb-ebf7a91f5814 1073741824" returned: 0 in 0.676s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:10:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-83624f59-02fe-44b4-9deb-ebf7a91f5814 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:10:36 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-83624f59-02fe-44b4-9deb-ebf7a91f5814 Jul 22 12:10:36 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:10:36 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Jul 22 12:10:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-83624f59-02fe-44b4-9deb-ebf7a91f5814" returned: 0 in 0.258s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:10:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:10:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:10:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5feb40f9-21c2-41c3-99f9-c0f4b8328a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83624f59-02fe-44b4-9deb-ebf7a91f5814', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:10:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea46ff3-285c-4fcc-8d37-4cc8986acb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:10:36 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Volume volume-83624f59-02fe-44b4-9deb-ebf7a91f5814 (83624f59-02fe-44b4-9deb-ebf7a91f5814): created successfully Jul 22 12:10:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea46ff3-285c-4fcc-8d37-4cc8986acb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:10:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Flow 'volume_create_manager' (fcffdc2f-f720-4d7a-98e0-152057a558c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:10:36 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-8c5dfea8-eff2-41c6-a05a-81aaa3077d4b tempest-DeleteServersTestJSON-46769978 None] Created volume successfully. Jul 22 12:10:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-71ce990b-99bc-4660-ad02-f46c9819b931 req-4332b1df-6650-4edc-a6b2-1c97e2c9ae6a tempest-DeleteServersTestJSON-46769978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:10:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-71ce990b-99bc-4660-ad02-f46c9819b931 req-4332b1df-6650-4edc-a6b2-1c97e2c9ae6a tempest-DeleteServersTestJSON-46769978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:10:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-71ce990b-99bc-4660-ad02-f46c9819b931 req-4332b1df-6650-4edc-a6b2-1c97e2c9ae6a tempest-DeleteServersTestJSON-46769978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:10:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-71ce990b-99bc-4660-ad02-f46c9819b931 req-4332b1df-6650-4edc-a6b2-1c97e2c9ae6a tempest-DeleteServersTestJSON-46769978 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29', 'name': 'volume-83624f59-02fe-44b4-9deb-ebf7a91f5814', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7763b293-8a39-4004-b5d7-dd8a5db00737', 'enforce_multipath': True} {{(pid=87568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 12:10:41 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-71ce990b-99bc-4660-ad02-f46c9819b931 req-4332b1df-6650-4edc-a6b2-1c97e2c9ae6a tempest-DeleteServersTestJSON-46769978 None] attachment_update completed successfully. Jul 22 12:10:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-10652e79-4db4-4ca7-98ad-e9b037d0b3c8 req-d2ae5169-1b54-438d-a843-b49d0a6eb597 tempest-TaggedAttachmentsTest-1916780798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:10:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-10652e79-4db4-4ca7-98ad-e9b037d0b3c8 req-d2ae5169-1b54-438d-a843-b49d0a6eb597 tempest-TaggedAttachmentsTest-1916780798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:10:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-10652e79-4db4-4ca7-98ad-e9b037d0b3c8 req-d2ae5169-1b54-438d-a843-b49d0a6eb597 tempest-TaggedAttachmentsTest-1916780798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:10:46 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-10652e79-4db4-4ca7-98ad-e9b037d0b3c8 req-d2ae5169-1b54-438d-a843-b49d0a6eb597 tempest-TaggedAttachmentsTest-1916780798 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29', 'name': 'volume-7d4b162a-9793-4fc6-909c-34f9cfcb1e04', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd87deb2-db2c-4621-8c57-5608711d7d07', 'enforce_multipath': True} {{(pid=87568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 12:10:47 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-10652e79-4db4-4ca7-98ad-e9b037d0b3c8 req-d2ae5169-1b54-438d-a843-b49d0a6eb597 tempest-TaggedAttachmentsTest-1916780798 None] attachment_update completed successfully. Jul 22 12:10:47 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-770c8c1d-56c4-425d-b0f2-99bb0a2da48d req-b8798d1c-30e4-4298-8090-7dd8603c9468 tempest-DeleteServersTestJSON-46769978 None] Terminate volume connection completed successfully. Jul 22 12:10:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-770c8c1d-56c4-425d-b0f2-99bb0a2da48d req-b8798d1c-30e4-4298-8090-7dd8603c9468 tempest-DeleteServersTestJSON-46769978 None] Deleting attachment 7763b293-8a39-4004-b5d7-dd8a5db00737. {{(pid=87568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 12:10:50 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-e2bdd172-7350-4360-aaff-e1323c9fd65f req-990937ae-8035-4a6e-95ac-307819647abc tempest-TaggedAttachmentsTest-1916780798 None] Terminate volume connection completed successfully. Jul 22 12:10:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-e2bdd172-7350-4360-aaff-e1323c9fd65f req-990937ae-8035-4a6e-95ac-307819647abc tempest-TaggedAttachmentsTest-1916780798 None] Deleting attachment fd87deb2-db2c-4621-8c57-5608711d7d07. {{(pid=87568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 12:10:50 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9eb3b397-69c8-4a20-82e1-1adc07205be5 tempest-DeleteServersTestJSON-46769978 None] Acquiring lock "cinder-83624f59-02fe-44b4-9deb-ebf7a91f5814-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:10:50 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9eb3b397-69c8-4a20-82e1-1adc07205be5 tempest-DeleteServersTestJSON-46769978 None] Lock "cinder-83624f59-02fe-44b4-9deb-ebf7a91f5814-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:10:50 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9eb3b397-69c8-4a20-82e1-1adc07205be5 tempest-DeleteServersTestJSON-46769978 None] Acquiring lock "cinder-quobyte-83624f59-02fe-44b4-9deb-ebf7a91f5814" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:10:50 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9eb3b397-69c8-4a20-82e1-1adc07205be5 tempest-DeleteServersTestJSON-46769978 None] Lock "cinder-quobyte-83624f59-02fe-44b4-9deb-ebf7a91f5814" acquired by "delete_volume" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:10:50 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e236f7-f7d7-4cbf-8472-835034125b4f]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:10:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9eb3b397-69c8-4a20-82e1-1adc07205be5 tempest-DeleteServersTestJSON-46769978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-83624f59-02fe-44b4-9deb-ebf7a91f5814 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:10:50 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-83624f59-02fe-44b4-9deb-ebf7a91f5814 Jul 22 12:10:50 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:10:50 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Jul 22 12:10:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9eb3b397-69c8-4a20-82e1-1adc07205be5 tempest-DeleteServersTestJSON-46769978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-83624f59-02fe-44b4-9deb-ebf7a91f5814" returned: 0 in 0.382s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:10:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9eb3b397-69c8-4a20-82e1-1adc07205be5 tempest-DeleteServersTestJSON-46769978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-83624f59-02fe-44b4-9deb-ebf7a91f5814 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:10:50 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-83624f59-02fe-44b4-9deb-ebf7a91f5814 Jul 22 12:10:50 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:10:51 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Jul 22 12:10:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9eb3b397-69c8-4a20-82e1-1adc07205be5 tempest-DeleteServersTestJSON-46769978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-83624f59-02fe-44b4-9deb-ebf7a91f5814" returned: 0 in 0.300s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:10:51 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9eb3b397-69c8-4a20-82e1-1adc07205be5 tempest-DeleteServersTestJSON-46769978 None] Lock "cinder-quobyte-83624f59-02fe-44b4-9deb-ebf7a91f5814" released by "delete_volume" :: held 0.727s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:10:51 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-9eb3b397-69c8-4a20-82e1-1adc07205be5 tempest-DeleteServersTestJSON-46769978 None] Created reservations ['5778d054-b1fd-4033-a31f-d2c4767fc6fc', '5b9b7528-c84e-4f8c-abcf-c6aaee9d5ac4', '92a67d14-6721-440b-97db-1bb661aeb2db', 'd0c89b5f-c115-47fa-80e6-5f80422dc398'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:10:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9eb3b397-69c8-4a20-82e1-1adc07205be5 tempest-DeleteServersTestJSON-46769978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:10:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9eb3b397-69c8-4a20-82e1-1adc07205be5 tempest-DeleteServersTestJSON-46769978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:10:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9eb3b397-69c8-4a20-82e1-1adc07205be5 tempest-DeleteServersTestJSON-46769978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:10:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9eb3b397-69c8-4a20-82e1-1adc07205be5 tempest-DeleteServersTestJSON-46769978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:10:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9eb3b397-69c8-4a20-82e1-1adc07205be5 tempest-DeleteServersTestJSON-46769978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:10:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9eb3b397-69c8-4a20-82e1-1adc07205be5 tempest-DeleteServersTestJSON-46769978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:10:51 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:10:51 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:10:51 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Jul 22 12:10:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9eb3b397-69c8-4a20-82e1-1adc07205be5 tempest-DeleteServersTestJSON-46769978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.322s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:10:51 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-9eb3b397-69c8-4a20-82e1-1adc07205be5 tempest-DeleteServersTestJSON-46769978 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:10:51 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-9eb3b397-69c8-4a20-82e1-1adc07205be5 tempest-DeleteServersTestJSON-46769978 None] Deleted volume successfully. Jul 22 12:10:51 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9eb3b397-69c8-4a20-82e1-1adc07205be5 tempest-DeleteServersTestJSON-46769978 None] Lock "cinder-83624f59-02fe-44b4-9deb-ebf7a91f5814-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:10:58 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:10:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Flow 'volume_create_manager' (72f5be34-d027-433c-9152-0fa3e599bb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:10:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75549ee-4204-43ac-99ae-312907fa5cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:10:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75549ee-4204-43ac-99ae-312907fa5cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1162909787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6811093-0e44-4843-83e8-a8bc0a0f8e85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c50e716b33c4d2abad6f03a6b818a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:10:59Z,use_quota=True,user_id='9a8fc03bff8c468d92ace9aa530b7f89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:10:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1a48cb-c626-4248-940c-d83cde4cf05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:10:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1a48cb-c626-4248-940c-d83cde4cf05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:10:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2774939-f72f-4053-97c0-614606547016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:10:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2774939-f72f-4053-97c0-614606547016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6811093-0e44-4843-83e8-a8bc0a0f8e85', 'volume_name': 'volume-b6811093-0e44-4843-83e8-a8bc0a0f8e85', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:10:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20061a01-a4fa-4881-945e-20fba1431734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:10:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20061a01-a4fa-4881-945e-20fba1431734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:10:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa76586b-4e4b-485c-a9e5-54ab16ee2ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:10:58 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Volume b6811093-0e44-4843-83e8-a8bc0a0f8e85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6811093-0e44-4843-83e8-a8bc0a0f8e85', 'volume_size': 1} Jul 22 12:10:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:10:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:10:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1162909787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6811093-0e44-4843-83e8-a8bc0a0f8e85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c50e716b33c4d2abad6f03a6b818a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:10:59Z,use_quota=True,user_id='9a8fc03bff8c468d92ace9aa530b7f89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:10:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Creating volume b6811093-0e44-4843-83e8-a8bc0a0f8e85 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:10:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:10:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:10:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:10:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:10:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:10:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:10:58 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:10:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b6811093-0e44-4843-83e8-a8bc0a0f8e85 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:10:58 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b6811093-0e44-4843-83e8-a8bc0a0f8e85 1073741824 Jul 22 12:10:58 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:10:59 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Jul 22 12:10:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b6811093-0e44-4843-83e8-a8bc0a0f8e85 1073741824" returned: 0 in 0.600s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:10:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b6811093-0e44-4843-83e8-a8bc0a0f8e85 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:10:59 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b6811093-0e44-4843-83e8-a8bc0a0f8e85 Jul 22 12:10:59 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:10:59 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Jul 22 12:10:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b6811093-0e44-4843-83e8-a8bc0a0f8e85" returned: 0 in 0.317s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:10:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:10:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:10:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa76586b-4e4b-485c-a9e5-54ab16ee2ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6811093-0e44-4843-83e8-a8bc0a0f8e85', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:10:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957885dd-ef9c-44f7-9186-2052197874d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:10:59 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Volume volume-b6811093-0e44-4843-83e8-a8bc0a0f8e85 (b6811093-0e44-4843-83e8-a8bc0a0f8e85): created successfully Jul 22 12:10:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957885dd-ef9c-44f7-9186-2052197874d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:10:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Flow 'volume_create_manager' (72f5be34-d027-433c-9152-0fa3e599bb23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:10:59 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-3bb7117c-38d9-4434-b000-ca9b338cd228 tempest-AttachVolumeTestJSON-1684010631 None] Created volume successfully. Jul 22 12:11:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5156b63-dfcd-4de3-aa4a-a073036ce33f tempest-TaggedAttachmentsTest-1916780798 None] Acquiring lock "cinder-7d4b162a-9793-4fc6-909c-34f9cfcb1e04-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:11:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5156b63-dfcd-4de3-aa4a-a073036ce33f tempest-TaggedAttachmentsTest-1916780798 None] Lock "cinder-7d4b162a-9793-4fc6-909c-34f9cfcb1e04-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:11:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5156b63-dfcd-4de3-aa4a-a073036ce33f tempest-TaggedAttachmentsTest-1916780798 None] Acquiring lock "cinder-quobyte-7d4b162a-9793-4fc6-909c-34f9cfcb1e04" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:11:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5156b63-dfcd-4de3-aa4a-a073036ce33f tempest-TaggedAttachmentsTest-1916780798 None] Lock "cinder-quobyte-7d4b162a-9793-4fc6-909c-34f9cfcb1e04" acquired by "delete_volume" :: waited 0.020s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:11:00 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5b6aa3-e25f-40b0-98a0-b53784dd6d02]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:11:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5156b63-dfcd-4de3-aa4a-a073036ce33f tempest-TaggedAttachmentsTest-1916780798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7d4b162a-9793-4fc6-909c-34f9cfcb1e04 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:11:01 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7d4b162a-9793-4fc6-909c-34f9cfcb1e04 Jul 22 12:11:01 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:11:01 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Jul 22 12:11:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5156b63-dfcd-4de3-aa4a-a073036ce33f tempest-TaggedAttachmentsTest-1916780798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7d4b162a-9793-4fc6-909c-34f9cfcb1e04" returned: 0 in 0.522s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:11:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5156b63-dfcd-4de3-aa4a-a073036ce33f tempest-TaggedAttachmentsTest-1916780798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7d4b162a-9793-4fc6-909c-34f9cfcb1e04 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:11:01 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7d4b162a-9793-4fc6-909c-34f9cfcb1e04 Jul 22 12:11:01 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:11:01 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Jul 22 12:11:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5156b63-dfcd-4de3-aa4a-a073036ce33f tempest-TaggedAttachmentsTest-1916780798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7d4b162a-9793-4fc6-909c-34f9cfcb1e04" returned: 0 in 0.425s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:11:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5156b63-dfcd-4de3-aa4a-a073036ce33f tempest-TaggedAttachmentsTest-1916780798 None] Lock "cinder-quobyte-7d4b162a-9793-4fc6-909c-34f9cfcb1e04" released by "delete_volume" :: held 1.022s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:11:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-54c67883-f6d4-4d85-9530-36b1828b88ec tempest-AttachVolumeShelveTestJSON-835995706 None] Acquiring lock "cinder-4224f895-a578-4aa0-911c-154d76d67b6f-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:11:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-54c67883-f6d4-4d85-9530-36b1828b88ec tempest-AttachVolumeShelveTestJSON-835995706 None] Lock "cinder-4224f895-a578-4aa0-911c-154d76d67b6f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:11:02 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-d5156b63-dfcd-4de3-aa4a-a073036ce33f tempest-TaggedAttachmentsTest-1916780798 None] Created reservations ['fcc78ad7-4a53-4568-89df-7d2f042f926b', 'b84dd85e-a5e1-4d8c-b5da-f5d6c6406e5a', '328595c2-3d52-4c58-9b55-bf72937b3e35', '8d7bf519-b7a0-4141-b61e-3fe7cd052eb8'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:11:02 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-54c67883-f6d4-4d85-9530-36b1828b88ec tempest-AttachVolumeShelveTestJSON-835995706 None] Acquiring lock "cinder-quobyte-4224f895-a578-4aa0-911c-154d76d67b6f" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:11:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-f93e68ac-c845-4c5e-b644-c792b0a986ea req-365a02ab-e5d1-4f31-bb16-74de23a217e8 tempest-AttachVolumeTestJSON-1684010631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:11:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-f93e68ac-c845-4c5e-b644-c792b0a986ea req-365a02ab-e5d1-4f31-bb16-74de23a217e8 tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:11:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-f93e68ac-c845-4c5e-b644-c792b0a986ea req-365a02ab-e5d1-4f31-bb16-74de23a217e8 tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:11:02 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-54c67883-f6d4-4d85-9530-36b1828b88ec tempest-AttachVolumeShelveTestJSON-835995706 None] Lock "cinder-quobyte-4224f895-a578-4aa0-911c-154d76d67b6f" acquired by "delete_volume" :: waited 0.032s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:11:02 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10bbd3f-fb19-4976-9b6a-49b0dffb2deb]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:11:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-54c67883-f6d4-4d85-9530-36b1828b88ec tempest-AttachVolumeShelveTestJSON-835995706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4224f895-a578-4aa0-911c-154d76d67b6f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:11:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-f93e68ac-c845-4c5e-b644-c792b0a986ea req-365a02ab-e5d1-4f31-bb16-74de23a217e8 tempest-AttachVolumeTestJSON-1684010631 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29', 'name': 'volume-b6811093-0e44-4843-83e8-a8bc0a0f8e85', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06fcfb71-058c-4ff8-ac1d-4016fe44a31c', 'enforce_multipath': True} {{(pid=87568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 12:11:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d5156b63-dfcd-4de3-aa4a-a073036ce33f tempest-TaggedAttachmentsTest-1916780798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:11:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d5156b63-dfcd-4de3-aa4a-a073036ce33f tempest-TaggedAttachmentsTest-1916780798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:11:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d5156b63-dfcd-4de3-aa4a-a073036ce33f tempest-TaggedAttachmentsTest-1916780798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:11:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d5156b63-dfcd-4de3-aa4a-a073036ce33f tempest-TaggedAttachmentsTest-1916780798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:11:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d5156b63-dfcd-4de3-aa4a-a073036ce33f tempest-TaggedAttachmentsTest-1916780798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:11:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5156b63-dfcd-4de3-aa4a-a073036ce33f tempest-TaggedAttachmentsTest-1916780798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:11:02 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:11:02 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:11:02 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-f93e68ac-c845-4c5e-b644-c792b0a986ea req-365a02ab-e5d1-4f31-bb16-74de23a217e8 tempest-AttachVolumeTestJSON-1684010631 None] attachment_update completed successfully. Jul 22 12:11:02 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4224f895-a578-4aa0-911c-154d76d67b6f Jul 22 12:11:02 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:11:02 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Jul 22 12:11:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5156b63-dfcd-4de3-aa4a-a073036ce33f tempest-TaggedAttachmentsTest-1916780798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.327s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:11:02 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-d5156b63-dfcd-4de3-aa4a-a073036ce33f tempest-TaggedAttachmentsTest-1916780798 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:11:02 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d5156b63-dfcd-4de3-aa4a-a073036ce33f tempest-TaggedAttachmentsTest-1916780798 None] Deleted volume successfully. Jul 22 12:11:02 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5156b63-dfcd-4de3-aa4a-a073036ce33f tempest-TaggedAttachmentsTest-1916780798 None] Lock "cinder-7d4b162a-9793-4fc6-909c-34f9cfcb1e04-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:11:02 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Jul 22 12:11:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-54c67883-f6d4-4d85-9530-36b1828b88ec tempest-AttachVolumeShelveTestJSON-835995706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4224f895-a578-4aa0-911c-154d76d67b6f" returned: 0 in 0.506s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:11:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-54c67883-f6d4-4d85-9530-36b1828b88ec tempest-AttachVolumeShelveTestJSON-835995706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4224f895-a578-4aa0-911c-154d76d67b6f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:11:02 devstack sudo[90869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4224f895-a578-4aa0-911c-154d76d67b6f Jul 22 12:11:02 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:11:02 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root Jul 22 12:11:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-54c67883-f6d4-4d85-9530-36b1828b88ec tempest-AttachVolumeShelveTestJSON-835995706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4224f895-a578-4aa0-911c-154d76d67b6f" returned: 0 in 0.359s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:11:03 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-54c67883-f6d4-4d85-9530-36b1828b88ec tempest-AttachVolumeShelveTestJSON-835995706 None] Lock "cinder-quobyte-4224f895-a578-4aa0-911c-154d76d67b6f" released by "delete_volume" :: held 0.920s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:11:03 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-54c67883-f6d4-4d85-9530-36b1828b88ec tempest-AttachVolumeShelveTestJSON-835995706 None] Created reservations ['8ec07512-c509-4e88-96cf-9703aa81037b', '809c7289-aedd-4ae7-9412-2f549f9e5f03', '6b19425a-4822-45fa-a615-0e68f78570e2', '31ac2538-591a-4305-956e-72ec5f46ce7d'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:11:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-54c67883-f6d4-4d85-9530-36b1828b88ec tempest-AttachVolumeShelveTestJSON-835995706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:11:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-54c67883-f6d4-4d85-9530-36b1828b88ec tempest-AttachVolumeShelveTestJSON-835995706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:11:03 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-54c67883-f6d4-4d85-9530-36b1828b88ec tempest-AttachVolumeShelveTestJSON-835995706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:11:03 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-54c67883-f6d4-4d85-9530-36b1828b88ec tempest-AttachVolumeShelveTestJSON-835995706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:11:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-54c67883-f6d4-4d85-9530-36b1828b88ec tempest-AttachVolumeShelveTestJSON-835995706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:11:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-54c67883-f6d4-4d85-9530-36b1828b88ec tempest-AttachVolumeShelveTestJSON-835995706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:11:03 devstack sudo[91081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:11:03 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:11:03 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root Jul 22 12:11:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-54c67883-f6d4-4d85-9530-36b1828b88ec tempest-AttachVolumeShelveTestJSON-835995706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.326s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:11:03 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-54c67883-f6d4-4d85-9530-36b1828b88ec tempest-AttachVolumeShelveTestJSON-835995706 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:11:03 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-54c67883-f6d4-4d85-9530-36b1828b88ec tempest-AttachVolumeShelveTestJSON-835995706 None] Deleted volume successfully. Jul 22 12:11:03 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-54c67883-f6d4-4d85-9530-36b1828b88ec tempest-AttachVolumeShelveTestJSON-835995706 None] Lock "cinder-4224f895-a578-4aa0-911c-154d76d67b6f-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:11:13 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=44,cinder:UPDATE=33,cinder:INSERT=8 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:11:13 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=37,cinder:UPDATE=36,cinder:INSERT=6,cinder:DELETE=5 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:11:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:11:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:11:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:11:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:11:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:11:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:11:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:11:24 devstack sudo[91745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:11:24 devstack sudo[91745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:11:24 devstack sudo[91745]: pam_unix(sudo:session): session closed for user root Jul 22 12:11:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.430s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:11:24 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:11:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:11:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread count: 8 {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:11:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread info: [<_MainThread(MainThread, started 137793405739136)>, , , , , , , ] {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:11:44 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-3e7359d2-7e2e-47c2-aad1-a679a77c3e7d req-d54f7f5a-f502-477a-b595-4ac6a47000bf tempest-AttachVolumeTestJSON-1684010631 None] Terminate volume connection completed successfully. Jul 22 12:11:44 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-3e7359d2-7e2e-47c2-aad1-a679a77c3e7d req-d54f7f5a-f502-477a-b595-4ac6a47000bf tempest-AttachVolumeTestJSON-1684010631 None] Deleting attachment 06fcfb71-058c-4ff8-ac1d-4016fe44a31c. {{(pid=87568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 12:11:47 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:11:54 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=2 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Flow 'volume_create_manager' (4bd71065-5dc9-46a1-b78f-9fe859b3cb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8a3acb-bc8b-4c7a-b9d3-70bcee9b6586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8a3acb-bc8b-4c7a-b9d3-70bcee9b6586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-762341150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0c0064-bf3b-45eb-ab3e-2e87642a0729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7ffaefef3348bba828f0231ee00782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:11:57Z,use_quota=True,user_id='9891147ed9ee420dbea4f512f6ea7d0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab0d543-fcdf-4e84-821f-aa9a47973505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab0d543-fcdf-4e84-821f-aa9a47973505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d128ae3-25b7-4b9d-b3f5-507d96bb8635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d128ae3-25b7-4b9d-b3f5-507d96bb8635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b0c0064-bf3b-45eb-ab3e-2e87642a0729', 'volume_name': 'volume-7b0c0064-bf3b-45eb-ab3e-2e87642a0729', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7326a72-ff40-4f35-86f8-5d192a9d9cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7326a72-ff40-4f35-86f8-5d192a9d9cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80e4744-4a70-4699-96b5-e18e398e556f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:11:57 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Volume 7b0c0064-bf3b-45eb-ab3e-2e87642a0729: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b0c0064-bf3b-45eb-ab3e-2e87642a0729', 'volume_size': 1} Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-762341150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0c0064-bf3b-45eb-ab3e-2e87642a0729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7ffaefef3348bba828f0231ee00782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:11:57Z,use_quota=True,user_id='9891147ed9ee420dbea4f512f6ea7d0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Creating volume 7b0c0064-bf3b-45eb-ab3e-2e87642a0729 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:11:57 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7b0c0064-bf3b-45eb-ab3e-2e87642a0729 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:11:57 devstack sudo[92148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7b0c0064-bf3b-45eb-ab3e-2e87642a0729 1073741824 Jul 22 12:11:57 devstack sudo[92148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:11:57 devstack sudo[92148]: pam_unix(sudo:session): session closed for user root Jul 22 12:11:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7b0c0064-bf3b-45eb-ab3e-2e87642a0729 1073741824" returned: 0 in 0.636s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:11:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7b0c0064-bf3b-45eb-ab3e-2e87642a0729 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:11:58 devstack sudo[92154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7b0c0064-bf3b-45eb-ab3e-2e87642a0729 Jul 22 12:11:58 devstack sudo[92154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:11:58 devstack sudo[92154]: pam_unix(sudo:session): session closed for user root Jul 22 12:11:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7b0c0064-bf3b-45eb-ab3e-2e87642a0729" returned: 0 in 0.512s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:11:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:11:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:11:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80e4744-4a70-4699-96b5-e18e398e556f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b0c0064-bf3b-45eb-ab3e-2e87642a0729', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:11:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea274e4e-4253-497d-aec0-b1531d7a0131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:11:58 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Volume volume-7b0c0064-bf3b-45eb-ab3e-2e87642a0729 (7b0c0064-bf3b-45eb-ab3e-2e87642a0729): created successfully Jul 22 12:11:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea274e4e-4253-497d-aec0-b1531d7a0131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:11:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Flow 'volume_create_manager' (4bd71065-5dc9-46a1-b78f-9fe859b3cb8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:11:58 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d3591476-f7d4-4ae4-bc42-e4b39b95324d tempest-ServersNegativeTestJSON-2102058189 None] Created volume successfully. Jul 22 12:12:03 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:12:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Flow 'volume_create_manager' (f230dcc0-a8ad-47d4-9ba5-1d125706a608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:12:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c13031a-27ee-4497-8955-0a7c5754a748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c13031a-27ee-4497-8955-0a7c5754a748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1476472840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7ccd3c-3737-4768-87f3-2eab6d2aca85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7ffaefef3348bba828f0231ee00782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:12:03Z,use_quota=True,user_id='9891147ed9ee420dbea4f512f6ea7d0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26df02d0-f5ae-4b41-8b0a-2c9cfe7f8d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26df02d0-f5ae-4b41-8b0a-2c9cfe7f8d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9178c231-b4c4-405d-b6bd-cf86f397bbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9178c231-b4c4-405d-b6bd-cf86f397bbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d7ccd3c-3737-4768-87f3-2eab6d2aca85', 'volume_name': 'volume-5d7ccd3c-3737-4768-87f3-2eab6d2aca85', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e497262-3d37-4159-adbb-5880083f3847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e497262-3d37-4159-adbb-5880083f3847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9925dc3d-03d1-4f09-84d8-4d8eebae09ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:03 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Volume 5d7ccd3c-3737-4768-87f3-2eab6d2aca85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d7ccd3c-3737-4768-87f3-2eab6d2aca85', 'volume_size': 1} Jul 22 12:12:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:12:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:12:03 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1476472840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7ccd3c-3737-4768-87f3-2eab6d2aca85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7ffaefef3348bba828f0231ee00782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:12:03Z,use_quota=True,user_id='9891147ed9ee420dbea4f512f6ea7d0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:12:03 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Creating volume 5d7ccd3c-3737-4768-87f3-2eab6d2aca85 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:12:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:12:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:12:03 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:12:03 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:12:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:12:03 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:12:03 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:12:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5d7ccd3c-3737-4768-87f3-2eab6d2aca85 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:03 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5d7ccd3c-3737-4768-87f3-2eab6d2aca85 1073741824 Jul 22 12:12:03 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:04 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5d7ccd3c-3737-4768-87f3-2eab6d2aca85 1073741824" returned: 0 in 0.830s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5d7ccd3c-3737-4768-87f3-2eab6d2aca85 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:04 devstack sudo[92242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5d7ccd3c-3737-4768-87f3-2eab6d2aca85 Jul 22 12:12:04 devstack sudo[92242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:05 devstack sudo[92242]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5d7ccd3c-3737-4768-87f3-2eab6d2aca85" returned: 0 in 0.474s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:05 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:12:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:12:05 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9925dc3d-03d1-4f09-84d8-4d8eebae09ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d7ccd3c-3737-4768-87f3-2eab6d2aca85', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:05 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7750f721-4f46-4eb6-b9e7-e27a5677241d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:05 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Volume volume-5d7ccd3c-3737-4768-87f3-2eab6d2aca85 (5d7ccd3c-3737-4768-87f3-2eab6d2aca85): created successfully Jul 22 12:12:05 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7750f721-4f46-4eb6-b9e7-e27a5677241d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:05 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Flow 'volume_create_manager' (f230dcc0-a8ad-47d4-9ba5-1d125706a608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:12:05 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-ea60200a-d267-4b11-83f8-fd0249d833d7 tempest-ServersNegativeTestJSON-2102058189 None] Created volume successfully. Jul 22 12:12:06 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ac026476-de32-47c4-8535-ad829deddd39 tempest-ServersNegativeTestJSON-2102058189 None] Acquiring lock "cinder-5d7ccd3c-3737-4768-87f3-2eab6d2aca85-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:12:06 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ac026476-de32-47c4-8535-ad829deddd39 tempest-ServersNegativeTestJSON-2102058189 None] Lock "cinder-5d7ccd3c-3737-4768-87f3-2eab6d2aca85-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:12:06 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ac026476-de32-47c4-8535-ad829deddd39 tempest-ServersNegativeTestJSON-2102058189 None] Acquiring lock "cinder-quobyte-5d7ccd3c-3737-4768-87f3-2eab6d2aca85" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:12:06 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ac026476-de32-47c4-8535-ad829deddd39 tempest-ServersNegativeTestJSON-2102058189 None] Lock "cinder-quobyte-5d7ccd3c-3737-4768-87f3-2eab6d2aca85" acquired by "delete_volume" :: waited 0.029s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:12:06 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[21363377-c764-4f21-987f-b3c5b3350ba7]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:12:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ac026476-de32-47c4-8535-ad829deddd39 tempest-ServersNegativeTestJSON-2102058189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5d7ccd3c-3737-4768-87f3-2eab6d2aca85 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:06 devstack sudo[92248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5d7ccd3c-3737-4768-87f3-2eab6d2aca85 Jul 22 12:12:06 devstack sudo[92248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:06 devstack sudo[92248]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ac026476-de32-47c4-8535-ad829deddd39 tempest-ServersNegativeTestJSON-2102058189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5d7ccd3c-3737-4768-87f3-2eab6d2aca85" returned: 0 in 0.415s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ac026476-de32-47c4-8535-ad829deddd39 tempest-ServersNegativeTestJSON-2102058189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5d7ccd3c-3737-4768-87f3-2eab6d2aca85 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:06 devstack sudo[92254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5d7ccd3c-3737-4768-87f3-2eab6d2aca85 Jul 22 12:12:06 devstack sudo[92254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:07 devstack sudo[92254]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ac026476-de32-47c4-8535-ad829deddd39 tempest-ServersNegativeTestJSON-2102058189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5d7ccd3c-3737-4768-87f3-2eab6d2aca85" returned: 0 in 0.299s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ac026476-de32-47c4-8535-ad829deddd39 tempest-ServersNegativeTestJSON-2102058189 None] Lock "cinder-quobyte-5d7ccd3c-3737-4768-87f3-2eab6d2aca85" released by "delete_volume" :: held 0.771s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:12:07 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-ac026476-de32-47c4-8535-ad829deddd39 tempest-ServersNegativeTestJSON-2102058189 None] Created reservations ['dcf83961-3169-43a4-a9fa-c7929741e796', 'fec6f266-4ec2-42f0-aab6-e480ae8077f9', 'e71e853f-5847-4122-8301-d1e4db0ae2be', 'bcfed888-1c2f-4793-a7dd-5332886df4b7'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:12:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ac026476-de32-47c4-8535-ad829deddd39 tempest-ServersNegativeTestJSON-2102058189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:12:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ac026476-de32-47c4-8535-ad829deddd39 tempest-ServersNegativeTestJSON-2102058189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:12:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ac026476-de32-47c4-8535-ad829deddd39 tempest-ServersNegativeTestJSON-2102058189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:12:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ac026476-de32-47c4-8535-ad829deddd39 tempest-ServersNegativeTestJSON-2102058189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:12:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ac026476-de32-47c4-8535-ad829deddd39 tempest-ServersNegativeTestJSON-2102058189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:12:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ac026476-de32-47c4-8535-ad829deddd39 tempest-ServersNegativeTestJSON-2102058189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:07 devstack sudo[92258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:12:07 devstack sudo[92258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7a07fcaf-34cd-4cb5-bc7b-844ed8689157 tempest-ServersNegativeTestJSON-2102058189 None] Acquiring lock "cinder-7b0c0064-bf3b-45eb-ab3e-2e87642a0729-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:12:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7a07fcaf-34cd-4cb5-bc7b-844ed8689157 tempest-ServersNegativeTestJSON-2102058189 None] Lock "cinder-7b0c0064-bf3b-45eb-ab3e-2e87642a0729-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:12:07 devstack sudo[92258]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ac026476-de32-47c4-8535-ad829deddd39 tempest-ServersNegativeTestJSON-2102058189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.378s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:07 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-ac026476-de32-47c4-8535-ad829deddd39 tempest-ServersNegativeTestJSON-2102058189 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:12:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7a07fcaf-34cd-4cb5-bc7b-844ed8689157 tempest-ServersNegativeTestJSON-2102058189 None] Acquiring lock "cinder-quobyte-7b0c0064-bf3b-45eb-ab3e-2e87642a0729" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:12:07 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-ac026476-de32-47c4-8535-ad829deddd39 tempest-ServersNegativeTestJSON-2102058189 None] Deleted volume successfully. Jul 22 12:12:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ac026476-de32-47c4-8535-ad829deddd39 tempest-ServersNegativeTestJSON-2102058189 None] Lock "cinder-5d7ccd3c-3737-4768-87f3-2eab6d2aca85-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:12:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7a07fcaf-34cd-4cb5-bc7b-844ed8689157 tempest-ServersNegativeTestJSON-2102058189 None] Lock "cinder-quobyte-7b0c0064-bf3b-45eb-ab3e-2e87642a0729" acquired by "delete_volume" :: waited 0.041s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:12:07 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b2af7c-62f7-4c95-a46d-8109d2dadb23]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:12:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7a07fcaf-34cd-4cb5-bc7b-844ed8689157 tempest-ServersNegativeTestJSON-2102058189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7b0c0064-bf3b-45eb-ab3e-2e87642a0729 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:07 devstack sudo[92289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7b0c0064-bf3b-45eb-ab3e-2e87642a0729 Jul 22 12:12:07 devstack sudo[92289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:08 devstack sudo[92289]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7a07fcaf-34cd-4cb5-bc7b-844ed8689157 tempest-ServersNegativeTestJSON-2102058189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7b0c0064-bf3b-45eb-ab3e-2e87642a0729" returned: 0 in 0.409s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7a07fcaf-34cd-4cb5-bc7b-844ed8689157 tempest-ServersNegativeTestJSON-2102058189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7b0c0064-bf3b-45eb-ab3e-2e87642a0729 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:08 devstack sudo[92294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7b0c0064-bf3b-45eb-ab3e-2e87642a0729 Jul 22 12:12:08 devstack sudo[92294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:08 devstack sudo[92294]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7a07fcaf-34cd-4cb5-bc7b-844ed8689157 tempest-ServersNegativeTestJSON-2102058189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7b0c0064-bf3b-45eb-ab3e-2e87642a0729" returned: 0 in 0.299s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:08 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7a07fcaf-34cd-4cb5-bc7b-844ed8689157 tempest-ServersNegativeTestJSON-2102058189 None] Lock "cinder-quobyte-7b0c0064-bf3b-45eb-ab3e-2e87642a0729" released by "delete_volume" :: held 0.760s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:12:08 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-7a07fcaf-34cd-4cb5-bc7b-844ed8689157 tempest-ServersNegativeTestJSON-2102058189 None] Created reservations ['274cafa9-0df5-406f-9e0e-2791b0a20668', '50086dab-b087-4103-a77a-7b408a3ee036', '2d4d6119-d2f2-4d88-8437-b9531c9c70b2', '173530cd-559d-4ae0-aa7d-7f816b75ca3c'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:12:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7a07fcaf-34cd-4cb5-bc7b-844ed8689157 tempest-ServersNegativeTestJSON-2102058189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:12:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7a07fcaf-34cd-4cb5-bc7b-844ed8689157 tempest-ServersNegativeTestJSON-2102058189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:12:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7a07fcaf-34cd-4cb5-bc7b-844ed8689157 tempest-ServersNegativeTestJSON-2102058189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:12:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7a07fcaf-34cd-4cb5-bc7b-844ed8689157 tempest-ServersNegativeTestJSON-2102058189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:12:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7a07fcaf-34cd-4cb5-bc7b-844ed8689157 tempest-ServersNegativeTestJSON-2102058189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:12:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7a07fcaf-34cd-4cb5-bc7b-844ed8689157 tempest-ServersNegativeTestJSON-2102058189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:08 devstack sudo[92297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:12:08 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:09 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7a07fcaf-34cd-4cb5-bc7b-844ed8689157 tempest-ServersNegativeTestJSON-2102058189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.342s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:09 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-7a07fcaf-34cd-4cb5-bc7b-844ed8689157 tempest-ServersNegativeTestJSON-2102058189 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:12:09 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-7a07fcaf-34cd-4cb5-bc7b-844ed8689157 tempest-ServersNegativeTestJSON-2102058189 None] Deleted volume successfully. Jul 22 12:12:09 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7a07fcaf-34cd-4cb5-bc7b-844ed8689157 tempest-ServersNegativeTestJSON-2102058189 None] Lock "cinder-7b0c0064-bf3b-45eb-ab3e-2e87642a0729-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=17,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Flow 'volume_create_manager' (349f3d98-95a0-41bf-965c-5f4c4c46c13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c6c7a0-79cf-4ad5-bb95-7c19e0712e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c6c7a0-79cf-4ad5-bb95-7c19e0712e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1470437251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b200f46-8c3b-4926-9f90-334f05d1cc5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016cc1ac17814b93bedc23fcf92d8a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:12:19Z,use_quota=True,user_id='fcef4427fa544f2480f12df2f496e096',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42b9bdf-39c6-4f5a-88ac-1ab6e01e7d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42b9bdf-39c6-4f5a-88ac-1ab6e01e7d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df970dd-ea78-45a3-b301-edf2b382cb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df970dd-ea78-45a3-b301-edf2b382cb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b200f46-8c3b-4926-9f90-334f05d1cc5c', 'volume_name': 'volume-4b200f46-8c3b-4926-9f90-334f05d1cc5c', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df51e3b-21b0-460f-a439-e7d49af5f97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df51e3b-21b0-460f-a439-e7d49af5f97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0264b5-06e4-40ad-8f86-d4abecbb342c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:18 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Volume 4b200f46-8c3b-4926-9f90-334f05d1cc5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b200f46-8c3b-4926-9f90-334f05d1cc5c', 'volume_size': 1} Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1470437251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b200f46-8c3b-4926-9f90-334f05d1cc5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016cc1ac17814b93bedc23fcf92d8a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:12:19Z,use_quota=True,user_id='fcef4427fa544f2480f12df2f496e096',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Creating volume 4b200f46-8c3b-4926-9f90-334f05d1cc5c {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:12:18 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:12:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b200f46-8c3b-4926-9f90-334f05d1cc5c 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:18 devstack sudo[92396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b200f46-8c3b-4926-9f90-334f05d1cc5c 1073741824 Jul 22 12:12:18 devstack sudo[92396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:19 devstack sudo[92396]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b200f46-8c3b-4926-9f90-334f05d1cc5c 1073741824" returned: 0 in 0.457s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b200f46-8c3b-4926-9f90-334f05d1cc5c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:19 devstack sudo[92402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b200f46-8c3b-4926-9f90-334f05d1cc5c Jul 22 12:12:19 devstack sudo[92402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:19 devstack sudo[92402]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b200f46-8c3b-4926-9f90-334f05d1cc5c" returned: 0 in 0.252s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0264b5-06e4-40ad-8f86-d4abecbb342c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b200f46-8c3b-4926-9f90-334f05d1cc5c', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dbee708-16ea-440e-bd62-db750d85744b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:19 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Volume volume-4b200f46-8c3b-4926-9f90-334f05d1cc5c (4b200f46-8c3b-4926-9f90-334f05d1cc5c): created successfully Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dbee708-16ea-440e-bd62-db750d85744b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Flow 'volume_create_manager' (349f3d98-95a0-41bf-965c-5f4c4c46c13b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:12:19 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-8e9468b2-52aa-4ea3-a1ea-6338409d312d tempest-AttachVolumeNegativeTest-1159479948 None] Created volume successfully. Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Flow 'volume_create_manager' (bf00058e-3788-43a3-9192-d9a4197d8d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4489df-a348-4918-8e90-7980a74ecdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4489df-a348-4918-8e90-7980a74ecdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1314955988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5272a00f-4e08-4afe-8afa-115f278d511f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3c4b927f3254b289daf4872c2595d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:12:20Z,use_quota=True,user_id='0b5ee23252024d01a9f16803dc4c78a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87b70614-4d87-4d4b-bf47-338c884725f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87b70614-4d87-4d4b-bf47-338c884725f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08379524-171d-49aa-a0be-fbdf3e0e4be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08379524-171d-49aa-a0be-fbdf3e0e4be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5272a00f-4e08-4afe-8afa-115f278d511f', 'volume_name': 'volume-5272a00f-4e08-4afe-8afa-115f278d511f', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec11d46a-2f4e-4355-8515-6d5473822265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec11d46a-2f4e-4355-8515-6d5473822265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da21766-8ba3-41c2-913e-c71eae9b0987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:19 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Volume 5272a00f-4e08-4afe-8afa-115f278d511f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5272a00f-4e08-4afe-8afa-115f278d511f', 'volume_size': 1} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1314955988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5272a00f-4e08-4afe-8afa-115f278d511f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3c4b927f3254b289daf4872c2595d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:12:20Z,use_quota=True,user_id='0b5ee23252024d01a9f16803dc4c78a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Creating volume 5272a00f-4e08-4afe-8afa-115f278d511f {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:12:19 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:12:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:19 devstack sudo[92405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f 1073741824 Jul 22 12:12:19 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:20 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f 1073741824" returned: 0 in 0.414s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:20 devstack sudo[92411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f Jul 22 12:12:20 devstack sudo[92411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:20 devstack sudo[92411]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f" returned: 0 in 0.269s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:20 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:12:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:12:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da21766-8ba3-41c2-913e-c71eae9b0987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5272a00f-4e08-4afe-8afa-115f278d511f', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83aca040-be83-4a68-accb-5b95378b181a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:20 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Volume volume-5272a00f-4e08-4afe-8afa-115f278d511f (5272a00f-4e08-4afe-8afa-115f278d511f): created successfully Jul 22 12:12:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83aca040-be83-4a68-accb-5b95378b181a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Flow 'volume_create_manager' (bf00058e-3788-43a3-9192-d9a4197d8d76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:12:20 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-2d6a69e0-1c43-418a-8396-d92d48eabfe2 req-5234df83-e30d-452e-9a38-ce7b2bb7515b tempest-VolumesSnapshotsTestJSON-1288019340 None] Created volume successfully. Jul 22 12:12:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-1d200763-bfe8-4a68-8c0d-4e53eb431363 req-eb07d400-d23d-41f9-8f3e-bfeb02a5b63d tempest-VolumesSnapshotsTestJSON-1288019340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:12:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-1d200763-bfe8-4a68-8c0d-4e53eb431363 req-eb07d400-d23d-41f9-8f3e-bfeb02a5b63d tempest-VolumesSnapshotsTestJSON-1288019340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:12:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [req-1d200763-bfe8-4a68-8c0d-4e53eb431363 req-eb07d400-d23d-41f9-8f3e-bfeb02a5b63d tempest-VolumesSnapshotsTestJSON-1288019340 None] Creating offline snapshot 6f3a0f8e-47f6-402d-ad38-26bd8b99050b of volume 5272a00f-4e08-4afe-8afa-115f278d511f {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:12:21 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[479d3889-e545-464f-943a-bb5c2be08960]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:12:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-1d200763-bfe8-4a68-8c0d-4e53eb431363 req-eb07d400-d23d-41f9-8f3e-bfeb02a5b63d tempest-VolumesSnapshotsTestJSON-1288019340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:21 devstack sudo[92419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f Jul 22 12:12:21 devstack sudo[92419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-219728ca-1283-44c5-991c-3c64c27249da req-9ca411a0-cf2b-46de-9e8f-358ca79860e5 tempest-AttachVolumeNegativeTest-1159479948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:12:21 devstack sudo[92419]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-1d200763-bfe8-4a68-8c0d-4e53eb431363 req-eb07d400-d23d-41f9-8f3e-bfeb02a5b63d tempest-VolumesSnapshotsTestJSON-1288019340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f" returned: 0 in 0.495s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-1d200763-bfe8-4a68-8c0d-4e53eb431363 req-eb07d400-d23d-41f9-8f3e-bfeb02a5b63d tempest-VolumesSnapshotsTestJSON-1288019340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.6f3a0f8e-47f6-402d-ad38-26bd8b99050b 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:21 devstack sudo[92432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.6f3a0f8e-47f6-402d-ad38-26bd8b99050b 1G Jul 22 12:12:21 devstack sudo[92432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:22 devstack sudo[92432]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-1d200763-bfe8-4a68-8c0d-4e53eb431363 req-eb07d400-d23d-41f9-8f3e-bfeb02a5b63d tempest-VolumesSnapshotsTestJSON-1288019340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.6f3a0f8e-47f6-402d-ad38-26bd8b99050b 1G" returned: 0 in 0.373s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-1d200763-bfe8-4a68-8c0d-4e53eb431363 req-eb07d400-d23d-41f9-8f3e-bfeb02a5b63d tempest-VolumesSnapshotsTestJSON-1288019340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5272a00f-4e08-4afe-8afa-115f278d511f -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.6f3a0f8e-47f6-402d-ad38-26bd8b99050b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:22 devstack sudo[92438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5272a00f-4e08-4afe-8afa-115f278d511f -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.6f3a0f8e-47f6-402d-ad38-26bd8b99050b Jul 22 12:12:22 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:22 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-1d200763-bfe8-4a68-8c0d-4e53eb431363 req-eb07d400-d23d-41f9-8f3e-bfeb02a5b63d tempest-VolumesSnapshotsTestJSON-1288019340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5272a00f-4e08-4afe-8afa-115f278d511f -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.6f3a0f8e-47f6-402d-ad38-26bd8b99050b" returned: 0 in 0.292s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:22 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [req-1d200763-bfe8-4a68-8c0d-4e53eb431363 req-eb07d400-d23d-41f9-8f3e-bfeb02a5b63d tempest-VolumesSnapshotsTestJSON-1288019340 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.6f3a0f8e-47f6-402d-ad38-26bd8b99050b is being set with open permissions: ugo+rw Jul 22 12:12:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-1d200763-bfe8-4a68-8c0d-4e53eb431363 req-eb07d400-d23d-41f9-8f3e-bfeb02a5b63d tempest-VolumesSnapshotsTestJSON-1288019340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.6f3a0f8e-47f6-402d-ad38-26bd8b99050b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:22 devstack sudo[92443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.6f3a0f8e-47f6-402d-ad38-26bd8b99050b Jul 22 12:12:22 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:22 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-1d200763-bfe8-4a68-8c0d-4e53eb431363 req-eb07d400-d23d-41f9-8f3e-bfeb02a5b63d tempest-VolumesSnapshotsTestJSON-1288019340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.6f3a0f8e-47f6-402d-ad38-26bd8b99050b" returned: 0 in 0.249s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-1d200763-bfe8-4a68-8c0d-4e53eb431363 req-eb07d400-d23d-41f9-8f3e-bfeb02a5b63d tempest-VolumesSnapshotsTestJSON-1288019340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:22 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.info Jul 22 12:12:22 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:23 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-1d200763-bfe8-4a68-8c0d-4e53eb431363 req-eb07d400-d23d-41f9-8f3e-bfeb02a5b63d tempest-VolumesSnapshotsTestJSON-1288019340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.info" returned: 0 in 0.253s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:23 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [req-1d200763-bfe8-4a68-8c0d-4e53eb431363 req-eb07d400-d23d-41f9-8f3e-bfeb02a5b63d tempest-VolumesSnapshotsTestJSON-1288019340 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.info is being set with open permissions: ugo+rw Jul 22 12:12:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-1d200763-bfe8-4a68-8c0d-4e53eb431363 req-eb07d400-d23d-41f9-8f3e-bfeb02a5b63d tempest-VolumesSnapshotsTestJSON-1288019340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:23 devstack sudo[92451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.info Jul 22 12:12:23 devstack sudo[92451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:23 devstack sudo[92451]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-1d200763-bfe8-4a68-8c0d-4e53eb431363 req-eb07d400-d23d-41f9-8f3e-bfeb02a5b63d tempest-VolumesSnapshotsTestJSON-1288019340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.info" returned: 0 in 0.251s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-1d200763-bfe8-4a68-8c0d-4e53eb431363 req-eb07d400-d23d-41f9-8f3e-bfeb02a5b63d tempest-VolumesSnapshotsTestJSON-1288019340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.059s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:12:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-219728ca-1283-44c5-991c-3c64c27249da req-9ca411a0-cf2b-46de-9e8f-358ca79860e5 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.631s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:12:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-219728ca-1283-44c5-991c-3c64c27249da req-9ca411a0-cf2b-46de-9e8f-358ca79860e5 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:12:23 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-1d200763-bfe8-4a68-8c0d-4e53eb431363 req-eb07d400-d23d-41f9-8f3e-bfeb02a5b63d tempest-VolumesSnapshotsTestJSON-1288019340 None] Create snapshot completed successfully Jul 22 12:12:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-219728ca-1283-44c5-991c-3c64c27249da req-9ca411a0-cf2b-46de-9e8f-358ca79860e5 tempest-AttachVolumeNegativeTest-1159479948 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29', 'name': 'volume-4b200f46-8c3b-4926-9f90-334f05d1cc5c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d38e982-b447-41ca-8793-d79dcc2ca632', 'enforce_multipath': True} {{(pid=87568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 12:12:23 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-219728ca-1283-44c5-991c-3c64c27249da req-9ca411a0-cf2b-46de-9e8f-358ca79860e5 tempest-AttachVolumeNegativeTest-1159479948 None] attachment_update completed successfully. Jul 22 12:12:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] Acquiring lock "cinder-6f3a0f8e-47f6-402d-ad38-26bd8b99050b-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] Lock "cinder-6f3a0f8e-47f6-402d-ad38-26bd8b99050b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] Acquiring lock "cinder-quobyte-5272a00f-4e08-4afe-8afa-115f278d511f" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] Lock "cinder-quobyte-5272a00f-4e08-4afe-8afa-115f278d511f" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] Acquiring lock "cinder-quobyte-6f3a0f8e-47f6-402d-ad38-26bd8b99050b" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] Lock "cinder-quobyte-6f3a0f8e-47f6-402d-ad38-26bd8b99050b" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] Deleting offline snapshot 6f3a0f8e-47f6-402d-ad38-26bd8b99050b of volume 5272a00f-4e08-4afe-8afa-115f278d511f {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] snapshot_file for this snap is: volume-5272a00f-4e08-4afe-8afa-115f278d511f.6f3a0f8e-47f6-402d-ad38-26bd8b99050b {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[059a9357-77de-4319-bf85-bce80e16f307]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.6f3a0f8e-47f6-402d-ad38-26bd8b99050b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:24 devstack sudo[92857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.6f3a0f8e-47f6-402d-ad38-26bd8b99050b Jul 22 12:12:24 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:24 devstack sudo[92860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:12:24 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:24 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.6f3a0f8e-47f6-402d-ad38-26bd8b99050b" returned: 0 in 0.592s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5272a00f-4e08-4afe-8afa-115f278d511f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4f7a3a-0a3b-4caf-a18f-b01aceb3e297]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:24 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:24 devstack sudo[92865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.571s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:12:24 devstack sudo[92865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread count: 8 {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:12:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread info: [<_MainThread(MainThread, started 137793405739136)>, , , , , , , ] {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:12:25 devstack sudo[92865]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f" returned: 0 in 0.595s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.6f3a0f8e-47f6-402d-ad38-26bd8b99050b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:25 devstack sudo[92873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.6f3a0f8e-47f6-402d-ad38-26bd8b99050b Jul 22 12:12:25 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:25 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.6f3a0f8e-47f6-402d-ad38-26bd8b99050b" returned: 0 in 0.452s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.6f3a0f8e-47f6-402d-ad38-26bd8b99050b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:25 devstack sudo[92880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.6f3a0f8e-47f6-402d-ad38-26bd8b99050b Jul 22 12:12:25 devstack sudo[92880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:26 devstack sudo[92880]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f.6f3a0f8e-47f6-402d-ad38-26bd8b99050b" returned: 0 in 0.310s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] Lock "cinder-quobyte-6f3a0f8e-47f6-402d-ad38-26bd8b99050b" released by "_delete_snapshot" :: held 2.128s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:12:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] Lock "cinder-quobyte-5272a00f-4e08-4afe-8afa-115f278d511f" released by "delete_snapshot" :: held 2.173s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:12:26 devstack cinder-volume[87568]: WARNING cinder.quota [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:12:26 devstack cinder-volume[87568]: DEBUG cinder.quota [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] Created reservations ['a713cd52-332b-45f2-9a08-4470e6521997', '1e71108b-8fbb-475d-b5e4-5ff54b5ccc99', '27e5a37d-ddb9-4855-8d05-f73e5fc8910d', '7c0b03eb-8391-426b-8775-bc9ee8ed5e0e'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:12:26 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] Delete snapshot completed successfully. Jul 22 12:12:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-060bed3f-b943-4319-93a9-4019cb78067c req-0df3d3e9-80b0-440a-af19-fbd7e4f9a6b2 tempest-VolumesSnapshotsTestJSON-1288019340 None] Lock "cinder-6f3a0f8e-47f6-402d-ad38-26bd8b99050b-delete_snapshot" released by "delete_snapshot" :: held 2.451s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:12:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-4c9cfaaa-f637-4cfe-a521-3542e36d6072 req-c72226ef-3077-497f-b2b0-7f67213cac18 tempest-VolumesSnapshotsTestJSON-1288019340 None] Acquiring lock "cinder-5272a00f-4e08-4afe-8afa-115f278d511f-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:12:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-4c9cfaaa-f637-4cfe-a521-3542e36d6072 req-c72226ef-3077-497f-b2b0-7f67213cac18 tempest-VolumesSnapshotsTestJSON-1288019340 None] Lock "cinder-5272a00f-4e08-4afe-8afa-115f278d511f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:12:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-4c9cfaaa-f637-4cfe-a521-3542e36d6072 req-c72226ef-3077-497f-b2b0-7f67213cac18 tempest-VolumesSnapshotsTestJSON-1288019340 None] Acquiring lock "cinder-quobyte-5272a00f-4e08-4afe-8afa-115f278d511f" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:12:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-4c9cfaaa-f637-4cfe-a521-3542e36d6072 req-c72226ef-3077-497f-b2b0-7f67213cac18 tempest-VolumesSnapshotsTestJSON-1288019340 None] Lock "cinder-quobyte-5272a00f-4e08-4afe-8afa-115f278d511f" acquired by "delete_volume" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:12:27 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5316848d-859f-43d7-be30-af1be4942e5b]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:12:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-4c9cfaaa-f637-4cfe-a521-3542e36d6072 req-c72226ef-3077-497f-b2b0-7f67213cac18 tempest-VolumesSnapshotsTestJSON-1288019340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:27 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f Jul 22 12:12:27 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:28 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-4c9cfaaa-f637-4cfe-a521-3542e36d6072 req-c72226ef-3077-497f-b2b0-7f67213cac18 tempest-VolumesSnapshotsTestJSON-1288019340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f" returned: 0 in 0.429s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-4c9cfaaa-f637-4cfe-a521-3542e36d6072 req-c72226ef-3077-497f-b2b0-7f67213cac18 tempest-VolumesSnapshotsTestJSON-1288019340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:28 devstack sudo[92890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f Jul 22 12:12:28 devstack sudo[92890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:28 devstack sudo[92890]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-4c9cfaaa-f637-4cfe-a521-3542e36d6072 req-c72226ef-3077-497f-b2b0-7f67213cac18 tempest-VolumesSnapshotsTestJSON-1288019340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5272a00f-4e08-4afe-8afa-115f278d511f" returned: 0 in 0.281s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-4c9cfaaa-f637-4cfe-a521-3542e36d6072 req-c72226ef-3077-497f-b2b0-7f67213cac18 tempest-VolumesSnapshotsTestJSON-1288019340 None] Lock "cinder-quobyte-5272a00f-4e08-4afe-8afa-115f278d511f" released by "delete_volume" :: held 0.803s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:12:28 devstack cinder-volume[87568]: DEBUG cinder.quota [req-4c9cfaaa-f637-4cfe-a521-3542e36d6072 req-c72226ef-3077-497f-b2b0-7f67213cac18 tempest-VolumesSnapshotsTestJSON-1288019340 None] Created reservations ['1cfc5767-c1cb-4b49-8b66-ba8fabc574c3', '7630cba7-f7ad-444c-a0bd-629fb5382f86', '6c8c50f0-d522-4463-ae78-77e6213863b0', '406fe568-afef-44d5-9b8c-7b9b8b487556'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:12:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-4c9cfaaa-f637-4cfe-a521-3542e36d6072 req-c72226ef-3077-497f-b2b0-7f67213cac18 tempest-VolumesSnapshotsTestJSON-1288019340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:12:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-4c9cfaaa-f637-4cfe-a521-3542e36d6072 req-c72226ef-3077-497f-b2b0-7f67213cac18 tempest-VolumesSnapshotsTestJSON-1288019340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:12:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [req-4c9cfaaa-f637-4cfe-a521-3542e36d6072 req-c72226ef-3077-497f-b2b0-7f67213cac18 tempest-VolumesSnapshotsTestJSON-1288019340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:12:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [req-4c9cfaaa-f637-4cfe-a521-3542e36d6072 req-c72226ef-3077-497f-b2b0-7f67213cac18 tempest-VolumesSnapshotsTestJSON-1288019340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:12:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-4c9cfaaa-f637-4cfe-a521-3542e36d6072 req-c72226ef-3077-497f-b2b0-7f67213cac18 tempest-VolumesSnapshotsTestJSON-1288019340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:12:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-4c9cfaaa-f637-4cfe-a521-3542e36d6072 req-c72226ef-3077-497f-b2b0-7f67213cac18 tempest-VolumesSnapshotsTestJSON-1288019340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:28 devstack sudo[92893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:12:28 devstack sudo[92893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:29 devstack sudo[92893]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-4c9cfaaa-f637-4cfe-a521-3542e36d6072 req-c72226ef-3077-497f-b2b0-7f67213cac18 tempest-VolumesSnapshotsTestJSON-1288019340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.410s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG cinder.manager [req-4c9cfaaa-f637-4cfe-a521-3542e36d6072 req-c72226ef-3077-497f-b2b0-7f67213cac18 tempest-VolumesSnapshotsTestJSON-1288019340 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:12:29 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-4c9cfaaa-f637-4cfe-a521-3542e36d6072 req-c72226ef-3077-497f-b2b0-7f67213cac18 tempest-VolumesSnapshotsTestJSON-1288019340 None] Deleted volume successfully. Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-4c9cfaaa-f637-4cfe-a521-3542e36d6072 req-c72226ef-3077-497f-b2b0-7f67213cac18 tempest-VolumesSnapshotsTestJSON-1288019340 None] Lock "cinder-5272a00f-4e08-4afe-8afa-115f278d511f-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Flow 'volume_create_manager' (16f1bf2e-e67e-4763-a25f-4b9d3b20fa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e11d6652-bb0e-4d60-b7a8-836b4fed951f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e11d6652-bb0e-4d60-b7a8-836b4fed951f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-145277099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85086688-3d97-480b-93c1-e5f3f196e54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='808c18e1d9a6494f853210e6eaf874b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:12:29Z,use_quota=True,user_id='18c5692091a6499d948142140b3ecf76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ca4826-b124-4482-b365-533d67345445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ca4826-b124-4482-b365-533d67345445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76f73ac-4441-4307-bb8f-e8ec7c63677b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76f73ac-4441-4307-bb8f-e8ec7c63677b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85086688-3d97-480b-93c1-e5f3f196e54a', 'volume_name': 'volume-85086688-3d97-480b-93c1-e5f3f196e54a', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d02a73-15fd-4058-84da-4586c9b9c00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d02a73-15fd-4058-84da-4586c9b9c00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eec6144-fa83-470f-9a9b-65cff8c3fef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:29 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Volume 85086688-3d97-480b-93c1-e5f3f196e54a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85086688-3d97-480b-93c1-e5f3f196e54a', 'volume_size': 1} Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-145277099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85086688-3d97-480b-93c1-e5f3f196e54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='808c18e1d9a6494f853210e6eaf874b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:12:29Z,use_quota=True,user_id='18c5692091a6499d948142140b3ecf76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Creating volume 85086688-3d97-480b-93c1-e5f3f196e54a {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:12:29 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:12:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-85086688-3d97-480b-93c1-e5f3f196e54a 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:29 devstack sudo[92896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-85086688-3d97-480b-93c1-e5f3f196e54a 1073741824 Jul 22 12:12:29 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:30 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-85086688-3d97-480b-93c1-e5f3f196e54a 1073741824" returned: 0 in 0.561s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-85086688-3d97-480b-93c1-e5f3f196e54a {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:30 devstack sudo[92904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-85086688-3d97-480b-93c1-e5f3f196e54a Jul 22 12:12:30 devstack sudo[92904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:30 devstack sudo[92904]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-85086688-3d97-480b-93c1-e5f3f196e54a" returned: 0 in 0.406s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:12:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:12:30 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eec6144-fa83-470f-9a9b-65cff8c3fef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85086688-3d97-480b-93c1-e5f3f196e54a', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:30 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25f35a6-4afb-4fb3-8447-c91cebc2a82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:30 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Volume volume-85086688-3d97-480b-93c1-e5f3f196e54a (85086688-3d97-480b-93c1-e5f3f196e54a): created successfully Jul 22 12:12:30 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25f35a6-4afb-4fb3-8447-c91cebc2a82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:30 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Flow 'volume_create_manager' (16f1bf2e-e67e-4763-a25f-4b9d3b20fa48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:12:30 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-72257cdd-dcc2-48f4-9bc2-97f918732848 tempest-ServerActionsTestOtherA-869975188 None] Created volume successfully. Jul 22 12:12:35 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-8522a9b6-5648-4d90-bc3f-1b31d9a90b4c tempest-GroupSnapshotsTest-1718471616 None] Group tempest-GroupSnapshotsTest-Group-1668675204: creating Jul 22 12:12:35 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-8522a9b6-5648-4d90-bc3f-1b31d9a90b4c tempest-GroupSnapshotsTest-1718471616 None] Group tempest-GroupSnapshotsTest-Group-1668675204: created successfully Jul 22 12:12:35 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-8522a9b6-5648-4d90-bc3f-1b31d9a90b4c tempest-GroupSnapshotsTest-1718471616 None] Create group completed successfully. Jul 22 12:12:37 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:12:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Flow 'volume_create_manager' (fbe32ff6-bb81-4e29-9e81-2b6e3bea7729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:12:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f17bfcd6-8371-488b-ae79-95dc09873d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f17bfcd6-8371-488b-ae79-95dc09873d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-152561760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e16a1bc-a2a7-43f2-b283-ea67d8acc584,host='devstack@QuobyteHD#QuobyteHD',id=51abf860-6f4a-4cc6-9e06-17ff62f075c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71c6791f2764af49818b1f31fa17969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:12:38Z,use_quota=True,user_id='9d5db42546ce46ab84931cc62328aaef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8b203af-0858-4e8d-8955-03e7c5b68be0),volume_type_id=f8b203af-0858-4e8d-8955-03e7c5b68be0)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b390ebc0-674d-43b3-8158-12837d0d0549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b390ebc0-674d-43b3-8158-12837d0d0549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06fcc95-d961-49e3-bc78-59ae5abcc53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06fcc95-d961-49e3-bc78-59ae5abcc53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51abf860-6f4a-4cc6-9e06-17ff62f075c3', 'volume_name': 'volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbc0442c-4a89-496b-bc5c-5d163cb1e13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbc0442c-4a89-496b-bc5c-5d163cb1e13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07625c2-f393-4479-97a4-69b1f801590b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:38 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Volume 51abf860-6f4a-4cc6-9e06-17ff62f075c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3', 'volume_size': 1} Jul 22 12:12:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:12:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:12:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6e16a1bc-a2a7-43f2-b283-ea67d8acc584,created_at=2026-07-22T10:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-152561760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e16a1bc-a2a7-43f2-b283-ea67d8acc584,host='devstack@QuobyteHD#QuobyteHD',id=51abf860-6f4a-4cc6-9e06-17ff62f075c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71c6791f2764af49818b1f31fa17969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:12:38Z,use_quota=True,user_id='9d5db42546ce46ab84931cc62328aaef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8b203af-0858-4e8d-8955-03e7c5b68be0),volume_type_id=f8b203af-0858-4e8d-8955-03e7c5b68be0)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:12:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Creating volume 51abf860-6f4a-4cc6-9e06-17ff62f075c3 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:12:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:12:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:12:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:12:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:12:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:12:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:12:38 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:12:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:38 devstack sudo[93031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 1073741824 Jul 22 12:12:38 devstack sudo[93031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:39 devstack sudo[93031]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 1073741824" returned: 0 in 1.227s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:39 devstack sudo[93051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 Jul 22 12:12:39 devstack sudo[93051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:39 devstack sudo[93051]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3" returned: 0 in 0.640s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:12:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:12:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07625c2-f393-4479-97a4-69b1f801590b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bee7617-f0cc-40f5-b3f6-c335880228a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:12:40 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Volume volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 (51abf860-6f4a-4cc6-9e06-17ff62f075c3): created successfully Jul 22 12:12:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bee7617-f0cc-40f5-b3f6-c335880228a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:12:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Flow 'volume_create_manager' (fbe32ff6-bb81-4e29-9e81-2b6e3bea7729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:12:40 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d1678514-6e91-4ff9-b88c-5d9d1b3c7c0b tempest-GroupSnapshotsTest-1718471616 None] Created volume successfully. Jul 22 12:12:40 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-8098cb4e-7498-4bfc-9a3c-f8e79a3573b4 tempest-GroupSnapshotsTest-1718471616 None] GroupSnapshot bc64b8a2-a49c-4b28-a814-21adbd61c540: creating. Jul 22 12:12:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8098cb4e-7498-4bfc-9a3c-f8e79a3573b4 tempest-GroupSnapshotsTest-1718471616 None] Group snapshot bc64b8a2-a49c-4b28-a814-21adbd61c540: creating. {{(pid=87568) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 22 12:12:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8098cb4e-7498-4bfc-9a3c-f8e79a3573b4 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:12:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8098cb4e-7498-4bfc-9a3c-f8e79a3573b4 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:12:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-8098cb4e-7498-4bfc-9a3c-f8e79a3573b4 tempest-GroupSnapshotsTest-1718471616 None] Creating offline snapshot 1002672c-6352-495e-ba0d-d21e5d0e008d of volume 51abf860-6f4a-4cc6-9e06-17ff62f075c3 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:12:41 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f08fcb-a57b-4376-ab68-a102bcc585e1]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:12:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8098cb4e-7498-4bfc-9a3c-f8e79a3573b4 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:41 devstack sudo[93056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 Jul 22 12:12:41 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:41 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8098cb4e-7498-4bfc-9a3c-f8e79a3573b4 tempest-GroupSnapshotsTest-1718471616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3" returned: 0 in 0.539s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8098cb4e-7498-4bfc-9a3c-f8e79a3573b4 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:41 devstack sudo[93062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d 1G Jul 22 12:12:41 devstack sudo[93062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:42 devstack sudo[93062]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8098cb4e-7498-4bfc-9a3c-f8e79a3573b4 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d 1G" returned: 0 in 0.646s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8098cb4e-7498-4bfc-9a3c-f8e79a3573b4 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:42 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d Jul 22 12:12:42 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:42 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8098cb4e-7498-4bfc-9a3c-f8e79a3573b4 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d" returned: 0 in 0.561s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:42 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-8098cb4e-7498-4bfc-9a3c-f8e79a3573b4 tempest-GroupSnapshotsTest-1718471616 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d is being set with open permissions: ugo+rw: NotImplementedError Jul 22 12:12:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8098cb4e-7498-4bfc-9a3c-f8e79a3573b4 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:42 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d Jul 22 12:12:42 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:43 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8098cb4e-7498-4bfc-9a3c-f8e79a3573b4 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d" returned: 0 in 1.038s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8098cb4e-7498-4bfc-9a3c-f8e79a3573b4 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:44 devstack sudo[93178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.info Jul 22 12:12:44 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:45 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8098cb4e-7498-4bfc-9a3c-f8e79a3573b4 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.info" returned: 0 in 1.070s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:45 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-8098cb4e-7498-4bfc-9a3c-f8e79a3573b4 tempest-GroupSnapshotsTest-1718471616 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 12:12:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8098cb4e-7498-4bfc-9a3c-f8e79a3573b4 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:45 devstack sudo[93201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.info Jul 22 12:12:45 devstack sudo[93201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:45 devstack sudo[93201]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8098cb4e-7498-4bfc-9a3c-f8e79a3573b4 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.info" returned: 0 in 0.845s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8098cb4e-7498-4bfc-9a3c-f8e79a3573b4 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.898s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:12:46 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-8098cb4e-7498-4bfc-9a3c-f8e79a3573b4 tempest-GroupSnapshotsTest-1718471616 None] group_snapshot bc64b8a2-a49c-4b28-a814-21adbd61c540: created successfully Jul 22 12:12:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:12:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:12:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "cinder-quobyte-1002672c-6352-495e-ba0d-d21e5d0e008d-b43a50dc-43c9-49b2-b19a-38df6373cee1" by "_create_volume_from_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:12:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-1002672c-6352-495e-ba0d-d21e5d0e008d-b43a50dc-43c9-49b2-b19a-38df6373cee1" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:12:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Creating volume b43a50dc-43c9-49b2-b19a-38df6373cee1 from snapshot 1002672c-6352-495e-ba0d-d21e5d0e008d {{(pid=87568) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 12:12:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:12:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:12:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:12:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:12:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:12:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:12:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "cinder-quobyte-b43a50dc-43c9-49b2-b19a-38df6373cee1" by "_copy_volume_from_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:12:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-b43a50dc-43c9-49b2-b19a-38df6373cee1" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:12:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] snapshot: 1002672c-6352-495e-ba0d-d21e5d0e008d, volume: b43a50dc-43c9-49b2-b19a-38df6373cee1, {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 12:12:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:12:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:12:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:12:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:12:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:12:48 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9ad2a0-3b79-463a-a53a-f84834cc8483]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:12:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:49 devstack sudo[93217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d Jul 22 12:12:49 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:49 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d" returned: 0 in 1.073s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:12:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] will copy from snapshot at /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 12:12:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Creating direct copy from snapshot {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 12:12:49 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b1bef6-1987-45d4-ba6f-1e7aea9d2d6e]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:12:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:50 devstack sudo[93223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 Jul 22 12:12:50 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:51 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root Jul 22 12:12:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3" returned: 0 in 1.120s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:12:51 devstack cinder-volume[87568]: DEBUG cinder.utils [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Path /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b43a50dc-43c9-49b2-b19a-38df6373cee1 not found in is_blk_device check {{(pid=87568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 12:12:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b43a50dc-43c9-49b2-b19a-38df6373cee1 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:12:51 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b43a50dc-43c9-49b2-b19a-38df6373cee1 Jul 22 12:12:51 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:12:58 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=36,cinder:INSERT=9,cinder:UPDATE=37,cinder:DELETE=3 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:12:58 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:UPDATE=46,cinder:DELETE=5,cinder:SELECT=52,cinder:INSERT=9 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:13:00 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b43a50dc-43c9-49b2-b19a-38df6373cee1" returned: 0 in 9.529s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:00 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[0534db00-9d74-48d7-9e52-fbdb80b47b10]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:13:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:00 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 Jul 22 12:13:00 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:01 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3" returned: 0 in 0.570s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:01 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Image conversion details: src /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3, size 1024.00 MB, duration 9.53 sec, destination /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b43a50dc-43c9-49b2-b19a-38df6373cee1 {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:13:01 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Converted 1024.00 MB image at 107.45 MB/s Jul 22 12:13:01 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b43a50dc-43c9-49b2-b19a-38df6373cee1 is being set with open permissions: ugo+rw: NotImplementedError Jul 22 12:13:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b43a50dc-43c9-49b2-b19a-38df6373cee1 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:01 devstack sudo[93292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b43a50dc-43c9-49b2-b19a-38df6373cee1 Jul 22 12:13:01 devstack sudo[93292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:01 devstack sudo[93292]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b43a50dc-43c9-49b2-b19a-38df6373cee1" returned: 0 in 0.276s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-b43a50dc-43c9-49b2-b19a-38df6373cee1" released by "_copy_volume_from_snapshot" :: held 12.798s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:13:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-1002672c-6352-495e-ba0d-d21e5d0e008d-b43a50dc-43c9-49b2-b19a-38df6373cee1" released by "_create_volume_from_snapshot" :: held 12.848s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:13:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.876s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:01 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-4a9c2d97-1939-4744-864e-a1d7776a3d68 tempest-GroupSnapshotsTest-1718471616 None] Create group from source-snapshot-bc64b8a2-a49c-4b28-a814-21adbd61c540 completed successfully. Jul 22 12:13:02 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-110fed1e-5150-4fbd-82c6-e2371a1176f2 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "cinder-quobyte-b43a50dc-43c9-49b2-b19a-38df6373cee1" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:13:02 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-110fed1e-5150-4fbd-82c6-e2371a1176f2 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-b43a50dc-43c9-49b2-b19a-38df6373cee1" acquired by "delete_volume" :: waited 0.029s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:13:02 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[886b3cca-6c38-4089-ac5b-505d9050602f]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:13:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-110fed1e-5150-4fbd-82c6-e2371a1176f2 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b43a50dc-43c9-49b2-b19a-38df6373cee1 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:03 devstack sudo[93295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b43a50dc-43c9-49b2-b19a-38df6373cee1 Jul 22 12:13:03 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:03 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-110fed1e-5150-4fbd-82c6-e2371a1176f2 tempest-GroupSnapshotsTest-1718471616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b43a50dc-43c9-49b2-b19a-38df6373cee1" returned: 0 in 0.582s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-110fed1e-5150-4fbd-82c6-e2371a1176f2 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b43a50dc-43c9-49b2-b19a-38df6373cee1 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:03 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b43a50dc-43c9-49b2-b19a-38df6373cee1 Jul 22 12:13:03 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:03 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-110fed1e-5150-4fbd-82c6-e2371a1176f2 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b43a50dc-43c9-49b2-b19a-38df6373cee1" returned: 0 in 0.297s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:03 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-110fed1e-5150-4fbd-82c6-e2371a1176f2 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-b43a50dc-43c9-49b2-b19a-38df6373cee1" released by "delete_volume" :: held 0.952s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:13:03 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-110fed1e-5150-4fbd-82c6-e2371a1176f2 tempest-GroupSnapshotsTest-1718471616 None] Created reservations ['eafcb65b-e793-4eb1-90ab-051e0045fa21'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:13:03 devstack cinder-volume[87568]: WARNING cinder.quota [None req-110fed1e-5150-4fbd-82c6-e2371a1176f2 tempest-GroupSnapshotsTest-1718471616 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1107536553 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1107536553, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:13:03 devstack cinder-volume[87568]: WARNING cinder.quota [None req-110fed1e-5150-4fbd-82c6-e2371a1176f2 tempest-GroupSnapshotsTest-1718471616 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1107536553 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1107536553, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:13:03 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-110fed1e-5150-4fbd-82c6-e2371a1176f2 tempest-GroupSnapshotsTest-1718471616 None] Created reservations ['74efc876-3727-4c86-bc6e-07dbb58a577f', 'c1aa4b9a-7c4c-4171-b48d-a0ad3d5f15e1', 'c14063f3-3268-44e0-af1c-d9a3723b0cc1', '5aced20f-c7b8-4898-8706-89d3cfc0f4c3'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:13:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-110fed1e-5150-4fbd-82c6-e2371a1176f2 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-110fed1e-5150-4fbd-82c6-e2371a1176f2 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:04 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-110fed1e-5150-4fbd-82c6-e2371a1176f2 tempest-GroupSnapshotsTest-1718471616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:13:04 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-110fed1e-5150-4fbd-82c6-e2371a1176f2 tempest-GroupSnapshotsTest-1718471616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:13:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-110fed1e-5150-4fbd-82c6-e2371a1176f2 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-110fed1e-5150-4fbd-82c6-e2371a1176f2 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:04 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:13:04 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:04 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-ebc423af-5fda-445f-a8fd-4e987c39e503 tempest-GroupSnapshotsTest-1718471616 None] group_snapshot bc64b8a2-a49c-4b28-a814-21adbd61c540: deleting Jul 22 12:13:04 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ebc423af-5fda-445f-a8fd-4e987c39e503 tempest-GroupSnapshotsTest-1718471616 None] group_snapshot bc64b8a2-a49c-4b28-a814-21adbd61c540: deleting {{(pid=87568) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 22 12:13:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ebc423af-5fda-445f-a8fd-4e987c39e503 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "cinder-quobyte-51abf860-6f4a-4cc6-9e06-17ff62f075c3" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:13:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ebc423af-5fda-445f-a8fd-4e987c39e503 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-51abf860-6f4a-4cc6-9e06-17ff62f075c3" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:13:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ebc423af-5fda-445f-a8fd-4e987c39e503 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "cinder-quobyte-1002672c-6352-495e-ba0d-d21e5d0e008d" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:13:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ebc423af-5fda-445f-a8fd-4e987c39e503 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-1002672c-6352-495e-ba0d-d21e5d0e008d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:13:04 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-ebc423af-5fda-445f-a8fd-4e987c39e503 tempest-GroupSnapshotsTest-1718471616 None] Deleting offline snapshot 1002672c-6352-495e-ba0d-d21e5d0e008d of volume 51abf860-6f4a-4cc6-9e06-17ff62f075c3 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:13:04 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:04 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-ebc423af-5fda-445f-a8fd-4e987c39e503 tempest-GroupSnapshotsTest-1718471616 None] snapshot_file for this snap is: volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:13:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-110fed1e-5150-4fbd-82c6-e2371a1176f2 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.435s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:04 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-110fed1e-5150-4fbd-82c6-e2371a1176f2 tempest-GroupSnapshotsTest-1718471616 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:13:04 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcb2062-869e-4158-a8bf-4dbadac7b9c4]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:13:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebc423af-5fda-445f-a8fd-4e987c39e503 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:04 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-110fed1e-5150-4fbd-82c6-e2371a1176f2 tempest-GroupSnapshotsTest-1718471616 None] Delete group completed successfully. Jul 22 12:13:04 devstack sudo[93373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d Jul 22 12:13:04 devstack sudo[93373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:04 devstack sudo[93373]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebc423af-5fda-445f-a8fd-4e987c39e503 tempest-GroupSnapshotsTest-1718471616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d" returned: 0 in 0.424s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:04 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-ebc423af-5fda-445f-a8fd-4e987c39e503 tempest-GroupSnapshotsTest-1718471616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:13:04 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e082eaa-f24f-4142-ac03-af0f6eabbdc4]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:13:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebc423af-5fda-445f-a8fd-4e987c39e503 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:05 devstack sudo[93406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 Jul 22 12:13:05 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:05 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebc423af-5fda-445f-a8fd-4e987c39e503 tempest-GroupSnapshotsTest-1718471616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3" returned: 0 in 0.379s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebc423af-5fda-445f-a8fd-4e987c39e503 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:05 devstack sudo[93411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d Jul 22 12:13:05 devstack sudo[93411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:05 devstack sudo[93411]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebc423af-5fda-445f-a8fd-4e987c39e503 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d" returned: 0 in 0.330s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebc423af-5fda-445f-a8fd-4e987c39e503 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:05 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d Jul 22 12:13:05 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:05 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebc423af-5fda-445f-a8fd-4e987c39e503 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3.1002672c-6352-495e-ba0d-d21e5d0e008d" returned: 0 in 0.253s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ebc423af-5fda-445f-a8fd-4e987c39e503 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-1002672c-6352-495e-ba0d-d21e5d0e008d" released by "_delete_snapshot" :: held 1.501s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:13:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ebc423af-5fda-445f-a8fd-4e987c39e503 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-51abf860-6f4a-4cc6-9e06-17ff62f075c3" released by "delete_snapshot" :: held 1.530s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:13:06 devstack cinder-volume[87568]: WARNING cinder.quota [None req-ebc423af-5fda-445f-a8fd-4e987c39e503 tempest-GroupSnapshotsTest-1718471616 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1107536553 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1107536553, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:13:06 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-ebc423af-5fda-445f-a8fd-4e987c39e503 tempest-GroupSnapshotsTest-1718471616 None] Created reservations ['7d2c6f8c-4769-4317-bfd0-6e5aa9e73291', 'c7e1cfa0-cd96-4ef0-a5c9-f21cfc39eede', '15c0264d-62a9-424e-9c84-d18d27f4728e', 'f1764780-2bfb-44b4-9191-152dc1db729d'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:13:06 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-ebc423af-5fda-445f-a8fd-4e987c39e503 tempest-GroupSnapshotsTest-1718471616 None] group_snapshot bc64b8a2-a49c-4b28-a814-21adbd61c540: deleted successfully Jul 22 12:13:06 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-65377303-2d67-48d6-b3e0-da867f9ee007 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "cinder-quobyte-51abf860-6f4a-4cc6-9e06-17ff62f075c3" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:13:06 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-65377303-2d67-48d6-b3e0-da867f9ee007 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-51abf860-6f4a-4cc6-9e06-17ff62f075c3" acquired by "delete_volume" :: waited 0.016s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:13:07 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65339d5-6f6a-4582-a166-8d104ec5a260]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:13:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-65377303-2d67-48d6-b3e0-da867f9ee007 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:07 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 Jul 22 12:13:07 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:07 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-65377303-2d67-48d6-b3e0-da867f9ee007 tempest-GroupSnapshotsTest-1718471616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3" returned: 0 in 0.358s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-65377303-2d67-48d6-b3e0-da867f9ee007 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:07 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3 Jul 22 12:13:07 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:07 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-65377303-2d67-48d6-b3e0-da867f9ee007 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51abf860-6f4a-4cc6-9e06-17ff62f075c3" returned: 0 in 0.251s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-65377303-2d67-48d6-b3e0-da867f9ee007 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-51abf860-6f4a-4cc6-9e06-17ff62f075c3" released by "delete_volume" :: held 0.667s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:13:07 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-65377303-2d67-48d6-b3e0-da867f9ee007 tempest-GroupSnapshotsTest-1718471616 None] Created reservations ['ed8a344b-ae48-46bd-83b1-54f93f1c7f1f'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:13:07 devstack cinder-volume[87568]: WARNING cinder.db.api [None req-65377303-2d67-48d6-b3e0-da867f9ee007 tempest-GroupSnapshotsTest-1718471616 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1107536553'] Jul 22 12:13:07 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-65377303-2d67-48d6-b3e0-da867f9ee007 tempest-GroupSnapshotsTest-1718471616 None] Created reservations ['20bb057b-4f7d-4c78-b31f-55b780494960', 'f1c35e3d-9b31-466b-b22b-5008ce2a3839', '1d8651d9-41dd-47d3-9a1d-c8a8ad7ca8d2', 'e35e6d38-3e11-4c6f-afc7-47f1812bdcd9'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:13:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-65377303-2d67-48d6-b3e0-da867f9ee007 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-65377303-2d67-48d6-b3e0-da867f9ee007 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-65377303-2d67-48d6-b3e0-da867f9ee007 tempest-GroupSnapshotsTest-1718471616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:13:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-65377303-2d67-48d6-b3e0-da867f9ee007 tempest-GroupSnapshotsTest-1718471616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:13:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-65377303-2d67-48d6-b3e0-da867f9ee007 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-65377303-2d67-48d6-b3e0-da867f9ee007 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:07 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:13:07 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:08 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-65377303-2d67-48d6-b3e0-da867f9ee007 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.242s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:08 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-65377303-2d67-48d6-b3e0-da867f9ee007 tempest-GroupSnapshotsTest-1718471616 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:13:08 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-65377303-2d67-48d6-b3e0-da867f9ee007 tempest-GroupSnapshotsTest-1718471616 None] Delete group completed successfully. Jul 22 12:13:08 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-124db076-f636-4f4a-bfe8-704d73fc792d tempest-GroupSnapshotsTest-1718471616 None] Group tempest-GroupSnapshotsTest-Group-1462478602: creating Jul 22 12:13:08 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-124db076-f636-4f4a-bfe8-704d73fc792d tempest-GroupSnapshotsTest-1718471616 None] Group tempest-GroupSnapshotsTest-Group-1462478602: created successfully Jul 22 12:13:08 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-124db076-f636-4f4a-bfe8-704d73fc792d tempest-GroupSnapshotsTest-1718471616 None] Create group completed successfully. Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Flow 'volume_create_manager' (352a379d-1534-4316-ad11-f9ce675c9f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7aebf78-e47e-4dce-8128-34365e71525d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7aebf78-e47e-4dce-8128-34365e71525d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-139173860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a1f87a26-2bb4-450c-95c3-50f23047c7c8,host='devstack@QuobyteHD#QuobyteHD',id=c2fef340-eacb-45a6-9aa9-3148f63a0a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71c6791f2764af49818b1f31fa17969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:13:10Z,use_quota=True,user_id='9d5db42546ce46ab84931cc62328aaef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(703ee50e-29ea-4721-9ec3-2bfae6186b14),volume_type_id=703ee50e-29ea-4721-9ec3-2bfae6186b14)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5759e66d-d723-4396-bcd1-a68ebff7d8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5759e66d-d723-4396-bcd1-a68ebff7d8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3044a2e-595c-4ac5-b238-50056a907414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3044a2e-595c-4ac5-b238-50056a907414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2fef340-eacb-45a6-9aa9-3148f63a0a62', 'volume_name': 'volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60e0c49-e480-45c8-9836-c9020ccbcda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60e0c49-e480-45c8-9836-c9020ccbcda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155d455f-19fb-4fca-a91d-4e545878edf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:10 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Volume c2fef340-eacb-45a6-9aa9-3148f63a0a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62', 'volume_size': 1} Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a1f87a26-2bb4-450c-95c3-50f23047c7c8,created_at=2026-07-22T10:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-139173860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a1f87a26-2bb4-450c-95c3-50f23047c7c8,host='devstack@QuobyteHD#QuobyteHD',id=c2fef340-eacb-45a6-9aa9-3148f63a0a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71c6791f2764af49818b1f31fa17969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:13:10Z,use_quota=True,user_id='9d5db42546ce46ab84931cc62328aaef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(703ee50e-29ea-4721-9ec3-2bfae6186b14),volume_type_id=703ee50e-29ea-4721-9ec3-2bfae6186b14)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Creating volume c2fef340-eacb-45a6-9aa9-3148f63a0a62 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:13:10 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:10 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62 1073741824 Jul 22 12:13:10 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:10 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62 1073741824" returned: 0 in 0.500s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:11 devstack sudo[93473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62 Jul 22 12:13:11 devstack sudo[93473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:11 devstack sudo[93473]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62" returned: 0 in 0.297s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:13:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155d455f-19fb-4fca-a91d-4e545878edf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11444dda-d398-4335-972f-824cbcdb7faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:11 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Volume volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62 (c2fef340-eacb-45a6-9aa9-3148f63a0a62): created successfully Jul 22 12:13:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11444dda-d398-4335-972f-824cbcdb7faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Flow 'volume_create_manager' (352a379d-1534-4316-ad11-f9ce675c9f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:13:11 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-4db7c3b2-8bcb-409f-9f8f-7d370e59ba55 tempest-GroupSnapshotsTest-1718471616 None] Created volume successfully. Jul 22 12:13:12 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:13:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Flow 'volume_create_manager' (9f48c825-083d-4f53-b8f1-ee2002264c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:13:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1bc1890-b472-4032-a898-3d885cf3b090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1bc1890-b472-4032-a898-3d885cf3b090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-376822325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a1f87a26-2bb4-450c-95c3-50f23047c7c8,host='devstack@QuobyteHD#QuobyteHD',id=528c00e6-92f0-453c-9335-29d89935a298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71c6791f2764af49818b1f31fa17969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:13:13Z,use_quota=True,user_id='9d5db42546ce46ab84931cc62328aaef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(703ee50e-29ea-4721-9ec3-2bfae6186b14),volume_type_id=703ee50e-29ea-4721-9ec3-2bfae6186b14)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad20964c-7596-4879-9808-71832067981f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad20964c-7596-4879-9808-71832067981f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef6d7c1-9d0c-4107-a483-54442a3506d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef6d7c1-9d0c-4107-a483-54442a3506d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '528c00e6-92f0-453c-9335-29d89935a298', 'volume_name': 'volume-528c00e6-92f0-453c-9335-29d89935a298', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2668bb3-22cb-4c07-80dd-a141d2907ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2668bb3-22cb-4c07-80dd-a141d2907ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccd371e7-39d8-4a62-aa88-7e1807060798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:12 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Volume 528c00e6-92f0-453c-9335-29d89935a298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-528c00e6-92f0-453c-9335-29d89935a298', 'volume_size': 1} Jul 22 12:13:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a1f87a26-2bb4-450c-95c3-50f23047c7c8,created_at=2026-07-22T10:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-376822325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a1f87a26-2bb4-450c-95c3-50f23047c7c8,host='devstack@QuobyteHD#QuobyteHD',id=528c00e6-92f0-453c-9335-29d89935a298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71c6791f2764af49818b1f31fa17969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:13:13Z,use_quota=True,user_id='9d5db42546ce46ab84931cc62328aaef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(703ee50e-29ea-4721-9ec3-2bfae6186b14),volume_type_id=703ee50e-29ea-4721-9ec3-2bfae6186b14)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:13:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Creating volume 528c00e6-92f0-453c-9335-29d89935a298 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:13:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:13:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:13:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:13:12 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:13:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:12 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298 1073741824 Jul 22 12:13:12 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:13 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298 1073741824" returned: 0 in 0.640s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:13 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298 Jul 22 12:13:13 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:13 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298" returned: 0 in 0.418s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:13:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccd371e7-39d8-4a62-aa88-7e1807060798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-528c00e6-92f0-453c-9335-29d89935a298', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ecb448-54d2-4eaa-808a-461e68e9857f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:13 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Volume volume-528c00e6-92f0-453c-9335-29d89935a298 (528c00e6-92f0-453c-9335-29d89935a298): created successfully Jul 22 12:13:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ecb448-54d2-4eaa-808a-461e68e9857f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Flow 'volume_create_manager' (9f48c825-083d-4f53-b8f1-ee2002264c98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:13:13 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b1d23f08-7de0-431b-a261-17935a62c899 tempest-GroupSnapshotsTest-1718471616 None] Created volume successfully. Jul 22 12:13:14 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-a71623cb-5da1-468c-9549-c315da052b1a req-2fd2b729-3021-48d0-9580-d51cc7016929 tempest-AttachVolumeNegativeTest-1159479948 None] Terminate volume connection completed successfully. Jul 22 12:13:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-a71623cb-5da1-468c-9549-c315da052b1a req-2fd2b729-3021-48d0-9580-d51cc7016929 tempest-AttachVolumeNegativeTest-1159479948 None] Deleting attachment 3d38e982-b447-41ca-8793-d79dcc2ca632. {{(pid=87568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 12:13:15 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-6004825e-1a04-4c58-aa51-367e69ad7d86 tempest-GroupSnapshotsTest-1718471616 None] Update group completed successfully. Jul 22 12:13:16 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b1e3208f-5acf-4eb3-a58a-43e3f0f9f0b5 tempest-GroupSnapshotsTest-1718471616 None] Update group completed successfully. Jul 22 12:13:17 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-3d4c50f2-7f69-4f0e-9588-74820a401b2c tempest-GroupSnapshotsTest-1718471616 None] Update group completed successfully. Jul 22 12:13:18 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-cca52f8f-8715-413c-8b57-77a2163502f6 tempest-GroupSnapshotsTest-1718471616 None] Update group completed successfully. Jul 22 12:13:20 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] GroupSnapshot d8788bcd-ebc5-4348-b419-bbb371a9ec29: creating. Jul 22 12:13:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] Group snapshot d8788bcd-ebc5-4348-b419-bbb371a9ec29: creating. {{(pid=87568) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 22 12:13:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:20 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] Creating offline snapshot 3c9e3355-5025-49bd-8b5f-dca7244ae429 of volume c2fef340-eacb-45a6-9aa9-3148f63a0a62 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:13:20 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9bd6bd-62e4-4270-8794-512e69a36947]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:13:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:20 devstack sudo[93551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62 Jul 22 12:13:20 devstack sudo[93551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:20 devstack sudo[93551]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62" returned: 0 in 0.371s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.3c9e3355-5025-49bd-8b5f-dca7244ae429 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:20 devstack sudo[93556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.3c9e3355-5025-49bd-8b5f-dca7244ae429 1G Jul 22 12:13:20 devstack sudo[93556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:21 devstack sudo[93556]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.3c9e3355-5025-49bd-8b5f-dca7244ae429 1G" returned: 0 in 0.431s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.3c9e3355-5025-49bd-8b5f-dca7244ae429 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:21 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.3c9e3355-5025-49bd-8b5f-dca7244ae429 Jul 22 12:13:21 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:21 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.3c9e3355-5025-49bd-8b5f-dca7244ae429" returned: 0 in 0.315s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:21 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.3c9e3355-5025-49bd-8b5f-dca7244ae429 is being set with open permissions: ugo+rw: NotImplementedError Jul 22 12:13:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.3c9e3355-5025-49bd-8b5f-dca7244ae429 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:21 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.3c9e3355-5025-49bd-8b5f-dca7244ae429 Jul 22 12:13:21 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:21 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.3c9e3355-5025-49bd-8b5f-dca7244ae429" returned: 0 in 0.278s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:21 devstack sudo[93572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.info Jul 22 12:13:21 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:22 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.info" returned: 0 in 0.273s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:22 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 12:13:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:22 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.info Jul 22 12:13:22 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:22 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.info" returned: 0 in 0.258s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] Creating offline snapshot 5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13 of volume 528c00e6-92f0-453c-9335-29d89935a298 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:13:22 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5551570-2cc5-4769-818d-564e0a23ca68]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:13:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:22 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298 Jul 22 12:13:22 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:22 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298" returned: 0 in 0.404s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:22 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13 1G Jul 22 12:13:22 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:23 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13 1G" returned: 0 in 0.450s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-528c00e6-92f0-453c-9335-29d89935a298 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:23 devstack sudo[93600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-528c00e6-92f0-453c-9335-29d89935a298 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13 Jul 22 12:13:23 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:23 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-528c00e6-92f0-453c-9335-29d89935a298 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13" returned: 0 in 0.405s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:23 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13 is being set with open permissions: ugo+rw: NotImplementedError Jul 22 12:13:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:23 devstack sudo[93611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13 Jul 22 12:13:23 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:23 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13" returned: 0 in 0.261s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:24 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.info Jul 22 12:13:24 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:24 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.info" returned: 0 in 0.254s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:24 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 12:13:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:24 devstack sudo[93617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.info Jul 22 12:13:24 devstack sudo[93617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:13:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:13:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:13:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:24 devstack sudo[93619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:13:24 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:24 devstack sudo[93617]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.info" returned: 0 in 0.287s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.176s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:24 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-df185528-45df-4986-91ba-214ccc1d6668 tempest-GroupSnapshotsTest-1718471616 None] group_snapshot d8788bcd-ebc5-4348-b419-bbb371a9ec29: created successfully Jul 22 12:13:24 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.323s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:24 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:13:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:13:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread count: 8 {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:13:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread info: [<_MainThread(MainThread, started 137793405739136)>, , , , , , , ] {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:13:25 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] group_snapshot d8788bcd-ebc5-4348-b419-bbb371a9ec29: deleting Jul 22 12:13:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] group_snapshot d8788bcd-ebc5-4348-b419-bbb371a9ec29: deleting {{(pid=87568) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 22 12:13:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "cinder-quobyte-c2fef340-eacb-45a6-9aa9-3148f63a0a62" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:13:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-c2fef340-eacb-45a6-9aa9-3148f63a0a62" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:13:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "cinder-quobyte-3c9e3355-5025-49bd-8b5f-dca7244ae429" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:13:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-3c9e3355-5025-49bd-8b5f-dca7244ae429" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:13:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Deleting offline snapshot 3c9e3355-5025-49bd-8b5f-dca7244ae429 of volume c2fef340-eacb-45a6-9aa9-3148f63a0a62 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:13:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] snapshot_file for this snap is: volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.3c9e3355-5025-49bd-8b5f-dca7244ae429 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:13:26 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[15807481-daf9-4e30-ab16-cdd1593c16d0]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:13:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.3c9e3355-5025-49bd-8b5f-dca7244ae429 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:26 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.3c9e3355-5025-49bd-8b5f-dca7244ae429 Jul 22 12:13:26 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:26 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.3c9e3355-5025-49bd-8b5f-dca7244ae429" returned: 0 in 0.652s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:13:26 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b394ee-3109-4304-bee1-02d882f26c64]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:13:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:27 devstack sudo[93696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62 Jul 22 12:13:27 devstack sudo[93696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:27 devstack sudo[93696]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62" returned: 0 in 0.482s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.3c9e3355-5025-49bd-8b5f-dca7244ae429 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:27 devstack sudo[93704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.3c9e3355-5025-49bd-8b5f-dca7244ae429 Jul 22 12:13:27 devstack sudo[93704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:27 devstack sudo[93704]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.3c9e3355-5025-49bd-8b5f-dca7244ae429" returned: 0 in 0.447s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.3c9e3355-5025-49bd-8b5f-dca7244ae429 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:27 devstack sudo[93713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.3c9e3355-5025-49bd-8b5f-dca7244ae429 Jul 22 12:13:27 devstack sudo[93713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:28 devstack sudo[93713]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62.3c9e3355-5025-49bd-8b5f-dca7244ae429" returned: 0 in 0.409s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-3c9e3355-5025-49bd-8b5f-dca7244ae429" released by "_delete_snapshot" :: held 2.214s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:13:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-c2fef340-eacb-45a6-9aa9-3148f63a0a62" released by "delete_snapshot" :: held 2.260s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:13:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "cinder-quobyte-528c00e6-92f0-453c-9335-29d89935a298" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:13:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-528c00e6-92f0-453c-9335-29d89935a298" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:13:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "cinder-quobyte-5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:13:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:13:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Deleting offline snapshot 5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13 of volume 528c00e6-92f0-453c-9335-29d89935a298 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:13:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] snapshot_file for this snap is: volume-528c00e6-92f0-453c-9335-29d89935a298.5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:13:28 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ef1121-7012-4266-b9b5-cb53dca0039b]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:13:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:28 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13 Jul 22 12:13:28 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:28 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:13:28 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Flow 'volume_create_manager' (b552ed0a-4fdd-438c-9349-f4c1e7de0008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6e5214-888e-4201-9258-40b40ce42494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6e5214-888e-4201-9258-40b40ce42494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1278700807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d870a78b-1d54-4df8-9135-6839719dfd5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c50e716b33c4d2abad6f03a6b818a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:13:29Z,use_quota=True,user_id='9a8fc03bff8c468d92ace9aa530b7f89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47f6066-55b4-4678-9303-2e2e2263273b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47f6066-55b4-4678-9303-2e2e2263273b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c0e669d-c666-43af-ac0e-a2d7b05a4856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c0e669d-c666-43af-ac0e-a2d7b05a4856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd870a78b-1d54-4df8-9135-6839719dfd5b', 'volume_name': 'volume-d870a78b-1d54-4df8-9135-6839719dfd5b', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb0d3c9-967a-45c6-b2f4-3961ee6e2b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb0d3c9-967a-45c6-b2f4-3961ee6e2b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c95c73db-9c77-4b56-803f-e5c7a4e9e58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:29 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Volume d870a78b-1d54-4df8-9135-6839719dfd5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d870a78b-1d54-4df8-9135-6839719dfd5b', 'volume_size': 1} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1278700807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d870a78b-1d54-4df8-9135-6839719dfd5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c50e716b33c4d2abad6f03a6b818a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:13:29Z,use_quota=True,user_id='9a8fc03bff8c468d92ace9aa530b7f89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Creating volume d870a78b-1d54-4df8-9135-6839719dfd5b {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:13:29 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d870a78b-1d54-4df8-9135-6839719dfd5b 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:29 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d870a78b-1d54-4df8-9135-6839719dfd5b 1073741824 Jul 22 12:13:29 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:29 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13" returned: 0 in 0.895s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-528c00e6-92f0-453c-9335-29d89935a298(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fff7064-3eab-4664-ab04-62be10d82f99]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:29 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298 Jul 22 12:13:29 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:29 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d870a78b-1d54-4df8-9135-6839719dfd5b 1073741824" returned: 0 in 0.815s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-a4099adf-7b9f-4675-9f51-50993a3f070a req-948271ae-e0d5-45cd-a266-89fd4ecd5af4 tempest-ServerActionsTestOtherA-869975188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d870a78b-1d54-4df8-9135-6839719dfd5b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:30 devstack sudo[93744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d870a78b-1d54-4df8-9135-6839719dfd5b Jul 22 12:13:30 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:30 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298" returned: 0 in 0.632s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:30 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13 Jul 22 12:13:30 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:30 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d870a78b-1d54-4df8-9135-6839719dfd5b" returned: 0 in 0.278s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:13:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-a4099adf-7b9f-4675-9f51-50993a3f070a req-948271ae-e0d5-45cd-a266-89fd4ecd5af4 tempest-ServerActionsTestOtherA-869975188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.351s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:30 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c95c73db-9c77-4b56-803f-e5c7a4e9e58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d870a78b-1d54-4df8-9135-6839719dfd5b', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:30 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (256ca1d4-851a-4c74-98cf-31aaa7b31ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-a4099adf-7b9f-4675-9f51-50993a3f070a req-948271ae-e0d5-45cd-a266-89fd4ecd5af4 tempest-ServerActionsTestOtherA-869975188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.055s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:30 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Volume volume-d870a78b-1d54-4df8-9135-6839719dfd5b (d870a78b-1d54-4df8-9135-6839719dfd5b): created successfully Jul 22 12:13:30 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (256ca1d4-851a-4c74-98cf-31aaa7b31ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:30 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Flow 'volume_create_manager' (b552ed0a-4fdd-438c-9349-f4c1e7de0008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:13:30 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-2b422486-fdd1-465b-8e5e-ef27609f1a12 tempest-AttachVolumeTestJSON-1684010631 None] Created volume successfully. Jul 22 12:13:30 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-a4099adf-7b9f-4675-9f51-50993a3f070a req-948271ae-e0d5-45cd-a266-89fd4ecd5af4 tempest-ServerActionsTestOtherA-869975188 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29', 'name': 'volume-85086688-3d97-480b-93c1-e5f3f196e54a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1a1f017-ea32-4eb8-b1d4-99469f0276ef', 'enforce_multipath': True} {{(pid=87568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 12:13:30 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-a4099adf-7b9f-4675-9f51-50993a3f070a req-948271ae-e0d5-45cd-a266-89fd4ecd5af4 tempest-ServerActionsTestOtherA-869975188 None] attachment_update completed successfully. Jul 22 12:13:30 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13" returned: 0 in 0.498s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:30 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13 Jul 22 12:13:30 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:31 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298.5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13" returned: 0 in 0.487s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-5a3d5102-4ef7-4c9c-91f8-680cc4fe8e13" released by "_delete_snapshot" :: held 2.712s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:13:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-528c00e6-92f0-453c-9335-29d89935a298" released by "delete_snapshot" :: held 2.770s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:13:31 devstack cinder-volume[87568]: WARNING cinder.quota [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1721436884 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1721436884, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:13:31 devstack cinder-volume[87568]: WARNING cinder.quota [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1721436884 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1721436884, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:13:31 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Created reservations ['a66c036f-fbab-4b0c-95b9-85841b74f605', '76a7d52f-856c-4fd2-a4c1-cc7c6a9ac2a7', '7f7e67a6-c4c1-499f-8f15-7c7fc0d4e1da', 'b35084be-5ac5-4ced-9ec5-eaaa2fc252de'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:13:31 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] Created reservations ['da317660-7db3-4b92-a948-f873db4ede43', '2c544631-c409-4eb4-adea-6a33183b734c', '868a0a04-23c6-44d1-b0e9-0db550d96f45', '83240c75-aeef-48d3-84b8-255a09161dd8'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:13:31 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-bafe620e-5714-46dc-87ed-b0081fd546b1 tempest-GroupSnapshotsTest-1718471616 None] group_snapshot d8788bcd-ebc5-4348-b419-bbb371a9ec29: deleted successfully Jul 22 12:13:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-7024f745-4e24-4c05-9ec2-21627b78cbde req-ca359c84-af91-4346-8454-d431fa9459e6 tempest-AttachVolumeTestJSON-1684010631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-7024f745-4e24-4c05-9ec2-21627b78cbde req-ca359c84-af91-4346-8454-d431fa9459e6 tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-7024f745-4e24-4c05-9ec2-21627b78cbde req-ca359c84-af91-4346-8454-d431fa9459e6 tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-7024f745-4e24-4c05-9ec2-21627b78cbde req-ca359c84-af91-4346-8454-d431fa9459e6 tempest-AttachVolumeTestJSON-1684010631 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29', 'name': 'volume-d870a78b-1d54-4df8-9135-6839719dfd5b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '728d5415-cbc4-4686-b7db-595b60bae659', 'enforce_multipath': True} {{(pid=87568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 12:13:32 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-7024f745-4e24-4c05-9ec2-21627b78cbde req-ca359c84-af91-4346-8454-d431fa9459e6 tempest-AttachVolumeTestJSON-1684010631 None] attachment_update completed successfully. Jul 22 12:13:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "cinder-quobyte-528c00e6-92f0-453c-9335-29d89935a298" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:13:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-528c00e6-92f0-453c-9335-29d89935a298" acquired by "delete_volume" :: waited 0.038s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:13:32 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c64d358-d634-40b1-8781-764a3f866295]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:13:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:33 devstack sudo[94156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298 Jul 22 12:13:33 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:33 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298" returned: 0 in 0.729s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:33 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298 Jul 22 12:13:33 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:33 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-528c00e6-92f0-453c-9335-29d89935a298" returned: 0 in 0.299s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-528c00e6-92f0-453c-9335-29d89935a298" released by "delete_volume" :: held 1.107s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:13:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "cinder-quobyte-c2fef340-eacb-45a6-9aa9-3148f63a0a62" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:13:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-c2fef340-eacb-45a6-9aa9-3148f63a0a62" acquired by "delete_volume" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:13:34 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86c4956-f69c-4a9a-91e4-da10b44b8615]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:13:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:34 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62 Jul 22 12:13:34 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:34 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-cc8ac981-870b-4ac8-9ce1-d4f465ac1c03 req-ec358ad0-203c-4a91-8a23-c44ef9a23062 tempest-ServerActionsTestOtherA-869975188 None] Terminate volume connection completed successfully. Jul 22 12:13:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-cc8ac981-870b-4ac8-9ce1-d4f465ac1c03 req-ec358ad0-203c-4a91-8a23-c44ef9a23062 tempest-ServerActionsTestOtherA-869975188 None] Deleting attachment b1a1f017-ea32-4eb8-b1d4-99469f0276ef. {{(pid=87568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 12:13:34 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62" returned: 0 in 0.679s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:34 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62 Jul 22 12:13:34 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:35 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c2fef340-eacb-45a6-9aa9-3148f63a0a62" returned: 0 in 0.671s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-c2fef340-eacb-45a6-9aa9-3148f63a0a62" released by "delete_volume" :: held 1.463s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:13:35 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] Created reservations ['386c23ef-bdd2-4b41-a53d-846874c4a969'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:13:35 devstack cinder-volume[87568]: WARNING cinder.quota [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1721436884 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1721436884, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:13:35 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] Created reservations ['b7876533-d23e-4f2d-af06-8f086f648587', '49d07a5c-e7f0-4262-ae77-af80fb98f99a', '8b9b066f-f338-4491-90f2-7c87b8a4e8dc', 'e72dafd9-ce58-4714-a25e-3fab9377ee74'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:13:35 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:13:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Flow 'volume_create_manager' (5c027f56-449e-4d05-b8b1-1eade3d5dcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:13:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8707b3af-acf5-422c-add3-7f0001689d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8707b3af-acf5-422c-add3-7f0001689d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-280827638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f412043b-a9f1-47e6-95ad-808321e663a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c50e716b33c4d2abad6f03a6b818a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:13:36Z,use_quota=True,user_id='9a8fc03bff8c468d92ace9aa530b7f89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (facd482d-279c-4233-ae27-66aab2aa7465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (facd482d-279c-4233-ae27-66aab2aa7465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca28297-e8e3-44ab-aaf5-737bb7231c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca28297-e8e3-44ab-aaf5-737bb7231c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f412043b-a9f1-47e6-95ad-808321e663a1', 'volume_name': 'volume-f412043b-a9f1-47e6-95ad-808321e663a1', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf84585-c0ee-4507-b39c-7f410f45e06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf84585-c0ee-4507-b39c-7f410f45e06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2e0b95-578f-4cb6-98c1-d58ea6ff3072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:36 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Volume f412043b-a9f1-47e6-95ad-808321e663a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f412043b-a9f1-47e6-95ad-808321e663a1', 'volume_size': 1} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-280827638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f412043b-a9f1-47e6-95ad-808321e663a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c50e716b33c4d2abad6f03a6b818a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:13:36Z,use_quota=True,user_id='9a8fc03bff8c468d92ace9aa530b7f89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Creating volume f412043b-a9f1-47e6-95ad-808321e663a1 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:13:36 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f412043b-a9f1-47e6-95ad-808321e663a1 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:36 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f412043b-a9f1-47e6-95ad-808321e663a1 1073741824 Jul 22 12:13:36 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-cc8ac981-870b-4ac8-9ce1-d4f465ac1c03 req-55f5e9d0-1a02-4837-be82-c12ca09e0bdc tempest-ServerActionsTestOtherA-869975188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] Created reservations ['533db860-b379-49a2-810a-00c82900f4b8', '118e4577-15a7-4593-96e9-dae9ed4ab94c', '27288575-e198-484a-8bfe-a811f4239620', 'd574968a-6ccc-4cce-bc45-f4da2ce2e30a'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:36 devstack sudo[94224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:13:36 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:36 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f412043b-a9f1-47e6-95ad-808321e663a1 1073741824" returned: 0 in 0.714s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f412043b-a9f1-47e6-95ad-808321e663a1 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:36 devstack sudo[94235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f412043b-a9f1-47e6-95ad-808321e663a1 Jul 22 12:13:36 devstack sudo[94235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:36 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.357s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:36 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:13:36 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-46eeeb85-98b5-495a-a71d-c7604d34b7e0 tempest-GroupSnapshotsTest-1718471616 None] Delete group completed successfully. Jul 22 12:13:37 devstack sudo[94235]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f412043b-a9f1-47e6-95ad-808321e663a1" returned: 0 in 0.288s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:13:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-cc8ac981-870b-4ac8-9ce1-d4f465ac1c03 req-55f5e9d0-1a02-4837-be82-c12ca09e0bdc tempest-ServerActionsTestOtherA-869975188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2e0b95-578f-4cb6-98c1-d58ea6ff3072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f412043b-a9f1-47e6-95ad-808321e663a1', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b21571e-59d0-4f8a-af84-0b58faba6a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-cc8ac981-870b-4ac8-9ce1-d4f465ac1c03 req-55f5e9d0-1a02-4837-be82-c12ca09e0bdc tempest-ServerActionsTestOtherA-869975188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:37 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Volume volume-f412043b-a9f1-47e6-95ad-808321e663a1 (f412043b-a9f1-47e6-95ad-808321e663a1): created successfully Jul 22 12:13:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b21571e-59d0-4f8a-af84-0b58faba6a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Flow 'volume_create_manager' (5c027f56-449e-4d05-b8b1-1eade3d5dcd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:13:37 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-15c30521-14cd-4ccc-bdcc-02388c9d3a9e tempest-AttachVolumeTestJSON-1684010631 None] Created volume successfully. Jul 22 12:13:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-cc8ac981-870b-4ac8-9ce1-d4f465ac1c03 req-55f5e9d0-1a02-4837-be82-c12ca09e0bdc tempest-ServerActionsTestOtherA-869975188 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29', 'name': 'volume-85086688-3d97-480b-93c1-e5f3f196e54a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8484c9a9-f641-4002-b5c3-7e1982e99d9b', 'enforce_multipath': True} {{(pid=87568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 12:13:37 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-cc8ac981-870b-4ac8-9ce1-d4f465ac1c03 req-55f5e9d0-1a02-4837-be82-c12ca09e0bdc tempest-ServerActionsTestOtherA-869975188 None] attachment_update completed successfully. Jul 22 12:13:37 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-32319bef-8062-445c-8c13-162ff8713491 tempest-GroupSnapshotsTest-1718471616 None] Group tempest-GroupSnapshotsTest-Group-1316511326: creating Jul 22 12:13:37 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-32319bef-8062-445c-8c13-162ff8713491 tempest-GroupSnapshotsTest-1718471616 None] Group tempest-GroupSnapshotsTest-Group-1316511326: created successfully Jul 22 12:13:37 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-32319bef-8062-445c-8c13-162ff8713491 tempest-GroupSnapshotsTest-1718471616 None] Create group completed successfully. Jul 22 12:13:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-761fb2de-1b13-4918-8b74-4047c39c403d req-d2b904ba-c257-4a18-9af8-3af64f8f0d82 tempest-AttachVolumeTestJSON-1684010631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-761fb2de-1b13-4918-8b74-4047c39c403d req-d2b904ba-c257-4a18-9af8-3af64f8f0d82 tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-761fb2de-1b13-4918-8b74-4047c39c403d req-d2b904ba-c257-4a18-9af8-3af64f8f0d82 tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-761fb2de-1b13-4918-8b74-4047c39c403d req-d2b904ba-c257-4a18-9af8-3af64f8f0d82 tempest-AttachVolumeTestJSON-1684010631 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29', 'name': 'volume-f412043b-a9f1-47e6-95ad-808321e663a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a1e9dee7-ee75-4628-ba2a-6f6b125e1296', 'enforce_multipath': True} {{(pid=87568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 12:13:39 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-761fb2de-1b13-4918-8b74-4047c39c403d req-d2b904ba-c257-4a18-9af8-3af64f8f0d82 tempest-AttachVolumeTestJSON-1684010631 None] attachment_update completed successfully. Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Flow 'volume_create_manager' (7323ac3d-e68b-4cd7-901b-49ff52c9506d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b4ca13c-77cc-4cc1-840d-893bbd830c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b4ca13c-77cc-4cc1-840d-893bbd830c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-92096305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c291c7e7-cff4-497b-9831-61ef904dd3d4,host='devstack@QuobyteHD#QuobyteHD',id=b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71c6791f2764af49818b1f31fa17969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:13:40Z,use_quota=True,user_id='9d5db42546ce46ab84931cc62328aaef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec6e22c4-2498-4d30-bdfd-ae2b870b6cd2),volume_type_id=ec6e22c4-2498-4d30-bdfd-ae2b870b6cd2)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d194f95-9a46-4b91-95a3-6df791138e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d194f95-9a46-4b91-95a3-6df791138e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c918c997-4f76-4843-b0e1-14666aaed7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c918c997-4f76-4843-b0e1-14666aaed7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11', 'volume_name': 'volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80f08ec-9f1a-4b9c-ac93-89698dcfbc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80f08ec-9f1a-4b9c-ac93-89698dcfbc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aff5a5e-2f43-4215-b732-58a9a8ff7550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:40 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Volume b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11', 'volume_size': 1} Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c291c7e7-cff4-497b-9831-61ef904dd3d4,created_at=2026-07-22T10:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-92096305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c291c7e7-cff4-497b-9831-61ef904dd3d4,host='devstack@QuobyteHD#QuobyteHD',id=b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71c6791f2764af49818b1f31fa17969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:13:40Z,use_quota=True,user_id='9d5db42546ce46ab84931cc62328aaef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec6e22c4-2498-4d30-bdfd-ae2b870b6cd2),volume_type_id=ec6e22c4-2498-4d30-bdfd-ae2b870b6cd2)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Creating volume b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:13:40 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:40 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11 1073741824 Jul 22 12:13:40 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:40 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11 1073741824" returned: 0 in 0.644s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:41 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11 Jul 22 12:13:41 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:41 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11" returned: 0 in 0.275s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:13:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aff5a5e-2f43-4215-b732-58a9a8ff7550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18164ef-0769-489b-b390-f93634e1ccd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:41 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Volume volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11 (b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11): created successfully Jul 22 12:13:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18164ef-0769-489b-b390-f93634e1ccd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Flow 'volume_create_manager' (7323ac3d-e68b-4cd7-901b-49ff52c9506d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:13:41 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e47d5d7a-332c-4381-802a-3006ec4616f8 tempest-GroupSnapshotsTest-1718471616 None] Created volume successfully. Jul 22 12:13:41 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-3c26740d-c55b-4dcc-960d-aa1b583e5e97 tempest-GroupSnapshotsTest-1718471616 None] GroupSnapshot 178487e2-a515-44fa-b103-10de6be9ccc3: creating. Jul 22 12:13:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3c26740d-c55b-4dcc-960d-aa1b583e5e97 tempest-GroupSnapshotsTest-1718471616 None] Group snapshot 178487e2-a515-44fa-b103-10de6be9ccc3: creating. {{(pid=87568) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 22 12:13:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3c26740d-c55b-4dcc-960d-aa1b583e5e97 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3c26740d-c55b-4dcc-960d-aa1b583e5e97 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-3c26740d-c55b-4dcc-960d-aa1b583e5e97 tempest-GroupSnapshotsTest-1718471616 None] Creating offline snapshot 1681a304-c874-4103-8205-73c8c7864720 of volume b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:13:42 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[4078691e-953e-4e48-a355-a65194d012a8]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:13:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3c26740d-c55b-4dcc-960d-aa1b583e5e97 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:42 devstack sudo[94359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11 Jul 22 12:13:42 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:42 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-0a52aeb1-83c1-4abc-84fe-be182b2c6dad req-8b072d32-258b-4a1f-ab72-a7df1f4fb16e tempest-AttachVolumeTestJSON-1684010631 None] Terminate volume connection completed successfully. Jul 22 12:13:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-0a52aeb1-83c1-4abc-84fe-be182b2c6dad req-8b072d32-258b-4a1f-ab72-a7df1f4fb16e tempest-AttachVolumeTestJSON-1684010631 None] Deleting attachment 728d5415-cbc4-4686-b7db-595b60bae659. {{(pid=87568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 12:13:42 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3c26740d-c55b-4dcc-960d-aa1b583e5e97 tempest-GroupSnapshotsTest-1718471616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11" returned: 0 in 0.495s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3c26740d-c55b-4dcc-960d-aa1b583e5e97 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.1681a304-c874-4103-8205-73c8c7864720 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:42 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.1681a304-c874-4103-8205-73c8c7864720 1G Jul 22 12:13:42 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:43 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3c26740d-c55b-4dcc-960d-aa1b583e5e97 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.1681a304-c874-4103-8205-73c8c7864720 1G" returned: 0 in 0.485s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3c26740d-c55b-4dcc-960d-aa1b583e5e97 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.1681a304-c874-4103-8205-73c8c7864720 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:43 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.1681a304-c874-4103-8205-73c8c7864720 Jul 22 12:13:43 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:43 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3c26740d-c55b-4dcc-960d-aa1b583e5e97 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.1681a304-c874-4103-8205-73c8c7864720" returned: 0 in 0.366s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:43 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-3c26740d-c55b-4dcc-960d-aa1b583e5e97 tempest-GroupSnapshotsTest-1718471616 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.1681a304-c874-4103-8205-73c8c7864720 is being set with open permissions: ugo+rw: NotImplementedError Jul 22 12:13:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3c26740d-c55b-4dcc-960d-aa1b583e5e97 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.1681a304-c874-4103-8205-73c8c7864720 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:43 devstack sudo[94380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.1681a304-c874-4103-8205-73c8c7864720 Jul 22 12:13:43 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:43 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3c26740d-c55b-4dcc-960d-aa1b583e5e97 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.1681a304-c874-4103-8205-73c8c7864720" returned: 0 in 0.308s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3c26740d-c55b-4dcc-960d-aa1b583e5e97 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:43 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.info Jul 22 12:13:43 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:43 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-10c2bbc8-2a58-404d-9f62-d7d698e79f93 req-bd251fdc-7964-4dc2-886f-21d6665e8f6c tempest-AttachVolumeTestJSON-1684010631 None] Terminate volume connection completed successfully. Jul 22 12:13:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-10c2bbc8-2a58-404d-9f62-d7d698e79f93 req-bd251fdc-7964-4dc2-886f-21d6665e8f6c tempest-AttachVolumeTestJSON-1684010631 None] Deleting attachment a1e9dee7-ee75-4628-ba2a-6f6b125e1296. {{(pid=87568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 12:13:44 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3c26740d-c55b-4dcc-960d-aa1b583e5e97 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.info" returned: 0 in 0.269s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:44 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-3c26740d-c55b-4dcc-960d-aa1b583e5e97 tempest-GroupSnapshotsTest-1718471616 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 12:13:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3c26740d-c55b-4dcc-960d-aa1b583e5e97 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:44 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.info Jul 22 12:13:44 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:44 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3c26740d-c55b-4dcc-960d-aa1b583e5e97 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.info" returned: 0 in 0.301s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3c26740d-c55b-4dcc-960d-aa1b583e5e97 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.329s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:44 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-3c26740d-c55b-4dcc-960d-aa1b583e5e97 tempest-GroupSnapshotsTest-1718471616 None] group_snapshot 178487e2-a515-44fa-b103-10de6be9ccc3: created successfully Jul 22 12:13:45 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] group_snapshot 178487e2-a515-44fa-b103-10de6be9ccc3: deleting Jul 22 12:13:45 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] group_snapshot 178487e2-a515-44fa-b103-10de6be9ccc3: deleting {{(pid=87568) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 22 12:13:45 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "cinder-quobyte-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:13:45 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:13:45 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "cinder-quobyte-1681a304-c874-4103-8205-73c8c7864720" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:13:45 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-1681a304-c874-4103-8205-73c8c7864720" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:13:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] Deleting offline snapshot 1681a304-c874-4103-8205-73c8c7864720 of volume b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:13:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] snapshot_file for this snap is: volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.1681a304-c874-4103-8205-73c8c7864720 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:13:45 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca08ba7a-eab1-4f37-badf-5287a0c197af]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:13:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.1681a304-c874-4103-8205-73c8c7864720 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:45 devstack sudo[94404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.1681a304-c874-4103-8205-73c8c7864720 Jul 22 12:13:45 devstack sudo[94404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:46 devstack sudo[94404]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.1681a304-c874-4103-8205-73c8c7864720" returned: 0 in 0.768s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:46 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:13:46 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7136ab0-136e-434f-8b7d-4ebb2fc9354c]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:13:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:46 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11 Jul 22 12:13:46 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:47 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11" returned: 0 in 0.890s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.1681a304-c874-4103-8205-73c8c7864720 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:47 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.1681a304-c874-4103-8205-73c8c7864720 Jul 22 12:13:47 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:47 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.1681a304-c874-4103-8205-73c8c7864720" returned: 0 in 0.538s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.1681a304-c874-4103-8205-73c8c7864720 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:47 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.1681a304-c874-4103-8205-73c8c7864720 Jul 22 12:13:47 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:48 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11.1681a304-c874-4103-8205-73c8c7864720" returned: 0 in 0.300s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-1681a304-c874-4103-8205-73c8c7864720" released by "_delete_snapshot" :: held 2.662s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:13:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11" released by "delete_snapshot" :: held 2.719s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:13:48 devstack cinder-volume[87568]: WARNING cinder.quota [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1944997378 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1944997378, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:13:48 devstack cinder-volume[87568]: WARNING cinder.quota [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1944997378 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1944997378, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:13:48 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] Created reservations ['77c276b5-97b4-4f3d-841f-c033ff4db02d', '1d5a9eb0-b398-4063-af23-3b2ae84fc53c', 'a50e5bf7-7226-41d3-9c35-b325dda816cd', '1cb74afb-42c2-4b46-94c4-0a912d49510f'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:13:48 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-218c224d-bcc7-4988-a896-b9a8cb32700f tempest-GroupSnapshotsTest-1718471616 None] group_snapshot 178487e2-a515-44fa-b103-10de6be9ccc3: deleted successfully Jul 22 12:13:49 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d0a50e63-e0dc-4f4a-89f0-bf56105df232 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "cinder-quobyte-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:13:49 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d0a50e63-e0dc-4f4a-89f0-bf56105df232 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11" acquired by "delete_volume" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:13:49 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[305e4c17-e7d0-4d47-9fdf-4163d0ffb8f2]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:13:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d0a50e63-e0dc-4f4a-89f0-bf56105df232 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:49 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11 Jul 22 12:13:49 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:49 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d0a50e63-e0dc-4f4a-89f0-bf56105df232 tempest-GroupSnapshotsTest-1718471616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11" returned: 0 in 0.393s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d0a50e63-e0dc-4f4a-89f0-bf56105df232 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:49 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11 Jul 22 12:13:49 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:49 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d0a50e63-e0dc-4f4a-89f0-bf56105df232 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11" returned: 0 in 0.263s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:50 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d0a50e63-e0dc-4f4a-89f0-bf56105df232 tempest-GroupSnapshotsTest-1718471616 None] Lock "cinder-quobyte-b63b9c2f-e82b-4b2e-9e2e-9abf5a249f11" released by "delete_volume" :: held 0.739s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:13:50 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-d0a50e63-e0dc-4f4a-89f0-bf56105df232 tempest-GroupSnapshotsTest-1718471616 None] Created reservations ['348ff84b-f785-4a1c-82d8-a5e8c65508a6'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:13:50 devstack cinder-volume[87568]: WARNING cinder.quota [None req-d0a50e63-e0dc-4f4a-89f0-bf56105df232 tempest-GroupSnapshotsTest-1718471616 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1944997378 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1944997378, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:13:50 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-d0a50e63-e0dc-4f4a-89f0-bf56105df232 tempest-GroupSnapshotsTest-1718471616 None] Created reservations ['868423b6-7b8c-4845-89b4-9e4bd4ea6c84', '94f80687-9cf9-448a-a12b-f37b89da8df6', 'eaf2fef5-99a2-418d-84b8-414e9ff1f600', '7b817864-7260-403a-b470-6a61063139c4'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:13:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d0a50e63-e0dc-4f4a-89f0-bf56105df232 tempest-GroupSnapshotsTest-1718471616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d0a50e63-e0dc-4f4a-89f0-bf56105df232 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:50 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d0a50e63-e0dc-4f4a-89f0-bf56105df232 tempest-GroupSnapshotsTest-1718471616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:13:50 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d0a50e63-e0dc-4f4a-89f0-bf56105df232 tempest-GroupSnapshotsTest-1718471616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:13:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d0a50e63-e0dc-4f4a-89f0-bf56105df232 tempest-GroupSnapshotsTest-1718471616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d0a50e63-e0dc-4f4a-89f0-bf56105df232 tempest-GroupSnapshotsTest-1718471616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:50 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:13:50 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:50 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d0a50e63-e0dc-4f4a-89f0-bf56105df232 tempest-GroupSnapshotsTest-1718471616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.365s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:50 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-d0a50e63-e0dc-4f4a-89f0-bf56105df232 tempest-GroupSnapshotsTest-1718471616 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:13:50 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d0a50e63-e0dc-4f4a-89f0-bf56105df232 tempest-GroupSnapshotsTest-1718471616 None] Delete group completed successfully. Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Flow 'volume_create_manager' (964a6863-0c95-4f69-a611-479b760edb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5f08e4-e8b6-44f6-8f1a-bfc9d24f892f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-952559b6-ffcf-4925-99f5-0931e525a385 tempest-AttachVolumeTestJSON-1684010631 None] Acquiring lock "cinder-f412043b-a9f1-47e6-95ad-808321e663a1-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5f08e4-e8b6-44f6-8f1a-bfc9d24f892f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1516351834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f799a766-4082-4c4d-9b4d-99d88db15b89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016cc1ac17814b93bedc23fcf92d8a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:13:51Z,use_quota=True,user_id='fcef4427fa544f2480f12df2f496e096',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583b7375-d31a-4000-99c2-8b88ca99e930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583b7375-d31a-4000-99c2-8b88ca99e930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c3a0cd-6764-472e-a7ee-ed5103a50f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c3a0cd-6764-472e-a7ee-ed5103a50f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f799a766-4082-4c4d-9b4d-99d88db15b89', 'volume_name': 'volume-f799a766-4082-4c4d-9b4d-99d88db15b89', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08af739-65c6-4102-b45b-93ea26514baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08af739-65c6-4102-b45b-93ea26514baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b269e38f-9008-42b5-b6ed-d1280787ed32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:51 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Volume f799a766-4082-4c4d-9b4d-99d88db15b89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f799a766-4082-4c4d-9b4d-99d88db15b89', 'volume_size': 1} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1516351834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f799a766-4082-4c4d-9b4d-99d88db15b89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016cc1ac17814b93bedc23fcf92d8a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:13:51Z,use_quota=True,user_id='fcef4427fa544f2480f12df2f496e096',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Creating volume f799a766-4082-4c4d-9b4d-99d88db15b89 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:13:51 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f799a766-4082-4c4d-9b4d-99d88db15b89 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-952559b6-ffcf-4925-99f5-0931e525a385 tempest-AttachVolumeTestJSON-1684010631 None] Lock "cinder-f412043b-a9f1-47e6-95ad-808321e663a1-delete_volume" acquired by "delete_volume" :: waited 0.129s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:13:51 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f799a766-4082-4c4d-9b4d-99d88db15b89 1073741824 Jul 22 12:13:51 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-952559b6-ffcf-4925-99f5-0931e525a385 tempest-AttachVolumeTestJSON-1684010631 None] Acquiring lock "cinder-quobyte-f412043b-a9f1-47e6-95ad-808321e663a1" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-952559b6-ffcf-4925-99f5-0931e525a385 tempest-AttachVolumeTestJSON-1684010631 None] Lock "cinder-quobyte-f412043b-a9f1-47e6-95ad-808321e663a1" acquired by "delete_volume" :: waited 0.016s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7274c6-6ed9-4982-8328-2b27072fe61f]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-952559b6-ffcf-4925-99f5-0931e525a385 tempest-AttachVolumeTestJSON-1684010631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f412043b-a9f1-47e6-95ad-808321e663a1 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:51 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f412043b-a9f1-47e6-95ad-808321e663a1 Jul 22 12:13:51 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:51 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-952559b6-ffcf-4925-99f5-0931e525a385 tempest-AttachVolumeTestJSON-1684010631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f412043b-a9f1-47e6-95ad-808321e663a1" returned: 0 in 0.440s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-952559b6-ffcf-4925-99f5-0931e525a385 tempest-AttachVolumeTestJSON-1684010631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f412043b-a9f1-47e6-95ad-808321e663a1 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:51 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f412043b-a9f1-47e6-95ad-808321e663a1 Jul 22 12:13:51 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:51 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f799a766-4082-4c4d-9b4d-99d88db15b89 1073741824" returned: 0 in 0.597s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f799a766-4082-4c4d-9b4d-99d88db15b89 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:51 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f799a766-4082-4c4d-9b4d-99d88db15b89 Jul 22 12:13:51 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:52 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-952559b6-ffcf-4925-99f5-0931e525a385 tempest-AttachVolumeTestJSON-1684010631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f412043b-a9f1-47e6-95ad-808321e663a1" returned: 0 in 0.394s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:52 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-952559b6-ffcf-4925-99f5-0931e525a385 tempest-AttachVolumeTestJSON-1684010631 None] Lock "cinder-quobyte-f412043b-a9f1-47e6-95ad-808321e663a1" released by "delete_volume" :: held 0.883s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:13:52 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f799a766-4082-4c4d-9b4d-99d88db15b89" returned: 0 in 0.351s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:13:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b269e38f-9008-42b5-b6ed-d1280787ed32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f799a766-4082-4c4d-9b4d-99d88db15b89', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3507234-9dc5-4257-876f-5c9a2a34fc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:52 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Volume volume-f799a766-4082-4c4d-9b4d-99d88db15b89 (f799a766-4082-4c4d-9b4d-99d88db15b89): created successfully Jul 22 12:13:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3507234-9dc5-4257-876f-5c9a2a34fc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Flow 'volume_create_manager' (964a6863-0c95-4f69-a611-479b760edb9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:13:52 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-7eedece2-bd45-4ee8-b77b-b89a8f34b1b9 tempest-AttachVolumeNegativeTest-1159479948 None] Created volume successfully. Jul 22 12:13:52 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-952559b6-ffcf-4925-99f5-0931e525a385 tempest-AttachVolumeTestJSON-1684010631 None] Created reservations ['27374972-a882-4a1e-8745-f487559c2b4d', '080f16bd-5648-47ac-a75f-b04f0e79a078', '929a2aab-b6bd-4b3e-a8dd-911c62358dd6', '98172f9e-9082-4f44-bfd3-f67691a280f9'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:13:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-952559b6-ffcf-4925-99f5-0931e525a385 tempest-AttachVolumeTestJSON-1684010631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-952559b6-ffcf-4925-99f5-0931e525a385 tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-952559b6-ffcf-4925-99f5-0931e525a385 tempest-AttachVolumeTestJSON-1684010631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:13:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-952559b6-ffcf-4925-99f5-0931e525a385 tempest-AttachVolumeTestJSON-1684010631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:13:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-952559b6-ffcf-4925-99f5-0931e525a385 tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-952559b6-ffcf-4925-99f5-0931e525a385 tempest-AttachVolumeTestJSON-1684010631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:52 devstack sudo[94491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:13:52 devstack sudo[94491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:52 devstack sudo[94491]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-952559b6-ffcf-4925-99f5-0931e525a385 tempest-AttachVolumeTestJSON-1684010631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.290s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:52 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-952559b6-ffcf-4925-99f5-0931e525a385 tempest-AttachVolumeTestJSON-1684010631 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:13:52 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-952559b6-ffcf-4925-99f5-0931e525a385 tempest-AttachVolumeTestJSON-1684010631 None] Deleted volume successfully. Jul 22 12:13:52 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-952559b6-ffcf-4925-99f5-0931e525a385 tempest-AttachVolumeTestJSON-1684010631 None] Lock "cinder-f412043b-a9f1-47e6-95ad-808321e663a1-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:13:53 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1414050e-13f0-45e1-831c-eb581ca838c9 tempest-AttachVolumeTestJSON-1684010631 None] Acquiring lock "cinder-d870a78b-1d54-4df8-9135-6839719dfd5b-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:13:53 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1414050e-13f0-45e1-831c-eb581ca838c9 tempest-AttachVolumeTestJSON-1684010631 None] Lock "cinder-d870a78b-1d54-4df8-9135-6839719dfd5b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:13:53 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1414050e-13f0-45e1-831c-eb581ca838c9 tempest-AttachVolumeTestJSON-1684010631 None] Acquiring lock "cinder-quobyte-d870a78b-1d54-4df8-9135-6839719dfd5b" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:13:53 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1414050e-13f0-45e1-831c-eb581ca838c9 tempest-AttachVolumeTestJSON-1684010631 None] Lock "cinder-quobyte-d870a78b-1d54-4df8-9135-6839719dfd5b" acquired by "delete_volume" :: waited 0.025s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:13:53 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[79985762-b4e2-4647-8ac1-f29e99ca40ee]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:13:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1414050e-13f0-45e1-831c-eb581ca838c9 tempest-AttachVolumeTestJSON-1684010631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d870a78b-1d54-4df8-9135-6839719dfd5b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:53 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d870a78b-1d54-4df8-9135-6839719dfd5b Jul 22 12:13:53 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-515e7bda-0135-4785-8964-2ab58a3edcec req-de63a080-0f46-4595-a2cc-be11e96eb7e2 tempest-AttachVolumeNegativeTest-1159479948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-515e7bda-0135-4785-8964-2ab58a3edcec req-de63a080-0f46-4595-a2cc-be11e96eb7e2 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-515e7bda-0135-4785-8964-2ab58a3edcec req-de63a080-0f46-4595-a2cc-be11e96eb7e2 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:54 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1414050e-13f0-45e1-831c-eb581ca838c9 tempest-AttachVolumeTestJSON-1684010631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d870a78b-1d54-4df8-9135-6839719dfd5b" returned: 0 in 0.562s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1414050e-13f0-45e1-831c-eb581ca838c9 tempest-AttachVolumeTestJSON-1684010631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d870a78b-1d54-4df8-9135-6839719dfd5b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:54 devstack sudo[94529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d870a78b-1d54-4df8-9135-6839719dfd5b Jul 22 12:13:54 devstack sudo[94529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:54 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-515e7bda-0135-4785-8964-2ab58a3edcec req-de63a080-0f46-4595-a2cc-be11e96eb7e2 tempest-AttachVolumeNegativeTest-1159479948 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29', 'name': 'volume-f799a766-4082-4c4d-9b4d-99d88db15b89', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c894859c-292c-4b60-969b-9899d9bd27f8', 'enforce_multipath': True} {{(pid=87568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 12:13:54 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-515e7bda-0135-4785-8964-2ab58a3edcec req-de63a080-0f46-4595-a2cc-be11e96eb7e2 tempest-AttachVolumeNegativeTest-1159479948 None] attachment_update completed successfully. Jul 22 12:13:54 devstack sudo[94529]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1414050e-13f0-45e1-831c-eb581ca838c9 tempest-AttachVolumeTestJSON-1684010631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d870a78b-1d54-4df8-9135-6839719dfd5b" returned: 0 in 0.356s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:54 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1414050e-13f0-45e1-831c-eb581ca838c9 tempest-AttachVolumeTestJSON-1684010631 None] Lock "cinder-quobyte-d870a78b-1d54-4df8-9135-6839719dfd5b" released by "delete_volume" :: held 1.010s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:13:54 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-1414050e-13f0-45e1-831c-eb581ca838c9 tempest-AttachVolumeTestJSON-1684010631 None] Created reservations ['e6c0a6ff-64ca-4a26-ada8-4cb564190ad4', '56b1ff55-d5e2-467d-a541-96fd6ad9ef5d', 'cc9a88e4-c435-4869-9d80-ecbc8a5e3d8d', 'd1dc6a01-ba18-45ee-8a9e-efab4cf81e56'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:13:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1414050e-13f0-45e1-831c-eb581ca838c9 tempest-AttachVolumeTestJSON-1684010631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1414050e-13f0-45e1-831c-eb581ca838c9 tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:54 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1414050e-13f0-45e1-831c-eb581ca838c9 tempest-AttachVolumeTestJSON-1684010631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:13:54 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1414050e-13f0-45e1-831c-eb581ca838c9 tempest-AttachVolumeTestJSON-1684010631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:13:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1414050e-13f0-45e1-831c-eb581ca838c9 tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1414050e-13f0-45e1-831c-eb581ca838c9 tempest-AttachVolumeTestJSON-1684010631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:54 devstack sudo[94546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:13:54 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:55 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1414050e-13f0-45e1-831c-eb581ca838c9 tempest-AttachVolumeTestJSON-1684010631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.358s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:55 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-1414050e-13f0-45e1-831c-eb581ca838c9 tempest-AttachVolumeTestJSON-1684010631 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:13:55 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-1414050e-13f0-45e1-831c-eb581ca838c9 tempest-AttachVolumeTestJSON-1684010631 None] Deleted volume successfully. Jul 22 12:13:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1414050e-13f0-45e1-831c-eb581ca838c9 tempest-AttachVolumeTestJSON-1684010631 None] Lock "cinder-d870a78b-1d54-4df8-9135-6839719dfd5b-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:13:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-aecd5b2b-b3f5-479e-9df5-994e943aeb48 tempest-AttachVolumeTestJSON-1684010631 None] Acquiring lock "cinder-b6811093-0e44-4843-83e8-a8bc0a0f8e85-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:13:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-aecd5b2b-b3f5-479e-9df5-994e943aeb48 tempest-AttachVolumeTestJSON-1684010631 None] Lock "cinder-b6811093-0e44-4843-83e8-a8bc0a0f8e85-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:13:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-aecd5b2b-b3f5-479e-9df5-994e943aeb48 tempest-AttachVolumeTestJSON-1684010631 None] Acquiring lock "cinder-quobyte-b6811093-0e44-4843-83e8-a8bc0a0f8e85" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:13:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-aecd5b2b-b3f5-479e-9df5-994e943aeb48 tempest-AttachVolumeTestJSON-1684010631 None] Lock "cinder-quobyte-b6811093-0e44-4843-83e8-a8bc0a0f8e85" acquired by "delete_volume" :: waited 0.033s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:13:56 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b2d55d-a1c7-4b45-8fe4-bf7558ee1708]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:13:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aecd5b2b-b3f5-479e-9df5-994e943aeb48 tempest-AttachVolumeTestJSON-1684010631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b6811093-0e44-4843-83e8-a8bc0a0f8e85 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:56 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b6811093-0e44-4843-83e8-a8bc0a0f8e85 Jul 22 12:13:56 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:56 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aecd5b2b-b3f5-479e-9df5-994e943aeb48 tempest-AttachVolumeTestJSON-1684010631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b6811093-0e44-4843-83e8-a8bc0a0f8e85" returned: 0 in 0.424s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aecd5b2b-b3f5-479e-9df5-994e943aeb48 tempest-AttachVolumeTestJSON-1684010631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b6811093-0e44-4843-83e8-a8bc0a0f8e85 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:56 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b6811093-0e44-4843-83e8-a8bc0a0f8e85 Jul 22 12:13:56 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:56 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aecd5b2b-b3f5-479e-9df5-994e943aeb48 tempest-AttachVolumeTestJSON-1684010631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b6811093-0e44-4843-83e8-a8bc0a0f8e85" returned: 0 in 0.324s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-aecd5b2b-b3f5-479e-9df5-994e943aeb48 tempest-AttachVolumeTestJSON-1684010631 None] Lock "cinder-quobyte-b6811093-0e44-4843-83e8-a8bc0a0f8e85" released by "delete_volume" :: held 0.808s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:13:56 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-aecd5b2b-b3f5-479e-9df5-994e943aeb48 tempest-AttachVolumeTestJSON-1684010631 None] Created reservations ['2cc3efb3-a4a2-4e05-aa46-0b1b16c0a940', 'ea1fb169-e685-462f-adb9-4aa692cbb5a1', 'b758a010-44fe-4671-b451-aaa26d1952e3', '8920d667-1680-4b34-9c18-eca42d3229b6'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:13:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aecd5b2b-b3f5-479e-9df5-994e943aeb48 tempest-AttachVolumeTestJSON-1684010631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aecd5b2b-b3f5-479e-9df5-994e943aeb48 tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:56 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-aecd5b2b-b3f5-479e-9df5-994e943aeb48 tempest-AttachVolumeTestJSON-1684010631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:13:56 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-aecd5b2b-b3f5-479e-9df5-994e943aeb48 tempest-AttachVolumeTestJSON-1684010631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:13:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aecd5b2b-b3f5-479e-9df5-994e943aeb48 tempest-AttachVolumeTestJSON-1684010631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aecd5b2b-b3f5-479e-9df5-994e943aeb48 tempest-AttachVolumeTestJSON-1684010631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:56 devstack sudo[94559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:13:56 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:57 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b7871687-2e83-4de5-85bb-0d951f9b43a5 tempest-GroupSnapshotsV319Test-1643047642 None] Group tempest-GroupSnapshotsV319Test-Group-158622367: creating Jul 22 12:13:57 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-eea707d0-9b0c-4a3c-97ef-3af6b2253d15 req-8f197a1f-3908-490e-9e56-23bd799166e2 tempest-AttachVolumeNegativeTest-1159479948 None] Terminate volume connection completed successfully. Jul 22 12:13:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-eea707d0-9b0c-4a3c-97ef-3af6b2253d15 req-8f197a1f-3908-490e-9e56-23bd799166e2 tempest-AttachVolumeNegativeTest-1159479948 None] Deleting attachment c894859c-292c-4b60-969b-9899d9bd27f8. {{(pid=87568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 12:13:57 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b7871687-2e83-4de5-85bb-0d951f9b43a5 tempest-GroupSnapshotsV319Test-1643047642 None] Group tempest-GroupSnapshotsV319Test-Group-158622367: created successfully Jul 22 12:13:57 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b7871687-2e83-4de5-85bb-0d951f9b43a5 tempest-GroupSnapshotsV319Test-1643047642 None] Create group completed successfully. Jul 22 12:13:57 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aecd5b2b-b3f5-479e-9df5-994e943aeb48 tempest-AttachVolumeTestJSON-1684010631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.291s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:57 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-aecd5b2b-b3f5-479e-9df5-994e943aeb48 tempest-AttachVolumeTestJSON-1684010631 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:13:57 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-aecd5b2b-b3f5-479e-9df5-994e943aeb48 tempest-AttachVolumeTestJSON-1684010631 None] Deleted volume successfully. Jul 22 12:13:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-aecd5b2b-b3f5-479e-9df5-994e943aeb48 tempest-AttachVolumeTestJSON-1684010631 None] Lock "cinder-b6811093-0e44-4843-83e8-a8bc0a0f8e85-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:UPDATE=141,cinder:SELECT=149,cinder:INSERT=35,cinder:DELETE=4 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:UPDATE=138,cinder:SELECT=166,cinder:INSERT=26,cinder:DELETE=5 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Flow 'volume_create_manager' (dabfefe0-1a88-4320-b129-645c2be55988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71dd2bcf-659d-4a4b-bf0a-f8ff8d1c93c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71dd2bcf-659d-4a4b-bf0a-f8ff8d1c93c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-287074734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2bd3e28-7b3e-497d-98b2-2dfc821abfe2,host='devstack@QuobyteHD#QuobyteHD',id=2706ce42-f374-4e46-bea0-e61891e80055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8762d936e3d415db9d00a678870860b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:13:59Z,use_quota=True,user_id='c94d10df07a34fb3aca579d6f7b2ed5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9a5264c-15e5-4f7e-9fe0-503ea6201c5d),volume_type_id=f9a5264c-15e5-4f7e-9fe0-503ea6201c5d)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ca1743-b6ae-4dd5-b110-11a902bc2e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ca1743-b6ae-4dd5-b110-11a902bc2e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c56729-f55c-4e6a-8c9c-856cc5e0aa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c56729-f55c-4e6a-8c9c-856cc5e0aa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2706ce42-f374-4e46-bea0-e61891e80055', 'volume_name': 'volume-2706ce42-f374-4e46-bea0-e61891e80055', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a0b495-eedb-4639-9a05-7d8c0238cd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a0b495-eedb-4639-9a05-7d8c0238cd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b542e97-931d-48b2-b8a6-f94986b66e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:13:59 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Volume 2706ce42-f374-4e46-bea0-e61891e80055: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2706ce42-f374-4e46-bea0-e61891e80055', 'volume_size': 1} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b2bd3e28-7b3e-497d-98b2-2dfc821abfe2,created_at=2026-07-22T10:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-287074734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2bd3e28-7b3e-497d-98b2-2dfc821abfe2,host='devstack@QuobyteHD#QuobyteHD',id=2706ce42-f374-4e46-bea0-e61891e80055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8762d936e3d415db9d00a678870860b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:13:59Z,use_quota=True,user_id='c94d10df07a34fb3aca579d6f7b2ed5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9a5264c-15e5-4f7e-9fe0-503ea6201c5d),volume_type_id=f9a5264c-15e5-4f7e-9fe0-503ea6201c5d)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Creating volume 2706ce42-f374-4e46-bea0-e61891e80055 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:13:59 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:59 devstack sudo[94586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055 1073741824 Jul 22 12:13:59 devstack sudo[94586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:13:59 devstack sudo[94586]: pam_unix(sudo:session): session closed for user root Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055 1073741824" returned: 0 in 0.661s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:13:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:13:59 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055 Jul 22 12:13:59 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:00 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055" returned: 0 in 0.277s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:14:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b542e97-931d-48b2-b8a6-f94986b66e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2706ce42-f374-4e46-bea0-e61891e80055', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8100a8c-c10c-4325-8d0a-89caf8449c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:00 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Volume volume-2706ce42-f374-4e46-bea0-e61891e80055 (2706ce42-f374-4e46-bea0-e61891e80055): created successfully Jul 22 12:14:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8100a8c-c10c-4325-8d0a-89caf8449c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Flow 'volume_create_manager' (dabfefe0-1a88-4320-b129-645c2be55988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:14:00 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-21b8e996-407d-44e0-82ca-1669232aaa69 tempest-GroupSnapshotsV319Test-1643047642 None] Created volume successfully. Jul 22 12:14:01 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-1acb6697-e355-4623-ae8d-d1e418eda803 tempest-GroupSnapshotsV319Test-1643047642 None] GroupSnapshot af9e121b-22ec-498d-b64c-abfb94d89792: creating. Jul 22 12:14:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1acb6697-e355-4623-ae8d-d1e418eda803 tempest-GroupSnapshotsV319Test-1643047642 None] Group snapshot af9e121b-22ec-498d-b64c-abfb94d89792: creating. {{(pid=87568) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 22 12:14:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1acb6697-e355-4623-ae8d-d1e418eda803 tempest-GroupSnapshotsV319Test-1643047642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1acb6697-e355-4623-ae8d-d1e418eda803 tempest-GroupSnapshotsV319Test-1643047642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-1acb6697-e355-4623-ae8d-d1e418eda803 tempest-GroupSnapshotsV319Test-1643047642 None] Creating offline snapshot dc3ef3fb-5634-4268-afc6-0e3b7ce1186d of volume 2706ce42-f374-4e46-bea0-e61891e80055 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:14:01 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8fbacb-58ec-4eac-972c-f6ff6760baa1]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:14:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1acb6697-e355-4623-ae8d-d1e418eda803 tempest-GroupSnapshotsV319Test-1643047642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:02 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055 Jul 22 12:14:02 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:02 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1acb6697-e355-4623-ae8d-d1e418eda803 tempest-GroupSnapshotsV319Test-1643047642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055" returned: 0 in 0.579s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1acb6697-e355-4623-ae8d-d1e418eda803 tempest-GroupSnapshotsV319Test-1643047642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.dc3ef3fb-5634-4268-afc6-0e3b7ce1186d 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:02 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.dc3ef3fb-5634-4268-afc6-0e3b7ce1186d 1G Jul 22 12:14:02 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:03 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1acb6697-e355-4623-ae8d-d1e418eda803 tempest-GroupSnapshotsV319Test-1643047642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.dc3ef3fb-5634-4268-afc6-0e3b7ce1186d 1G" returned: 0 in 0.686s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1acb6697-e355-4623-ae8d-d1e418eda803 tempest-GroupSnapshotsV319Test-1643047642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2706ce42-f374-4e46-bea0-e61891e80055 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.dc3ef3fb-5634-4268-afc6-0e3b7ce1186d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:03 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2706ce42-f374-4e46-bea0-e61891e80055 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.dc3ef3fb-5634-4268-afc6-0e3b7ce1186d Jul 22 12:14:03 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:03 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1acb6697-e355-4623-ae8d-d1e418eda803 tempest-GroupSnapshotsV319Test-1643047642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2706ce42-f374-4e46-bea0-e61891e80055 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.dc3ef3fb-5634-4268-afc6-0e3b7ce1186d" returned: 0 in 0.522s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:03 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-1acb6697-e355-4623-ae8d-d1e418eda803 tempest-GroupSnapshotsV319Test-1643047642 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.dc3ef3fb-5634-4268-afc6-0e3b7ce1186d is being set with open permissions: ugo+rw: NotImplementedError Jul 22 12:14:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1acb6697-e355-4623-ae8d-d1e418eda803 tempest-GroupSnapshotsV319Test-1643047642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.dc3ef3fb-5634-4268-afc6-0e3b7ce1186d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:03 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.dc3ef3fb-5634-4268-afc6-0e3b7ce1186d Jul 22 12:14:03 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:04 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1acb6697-e355-4623-ae8d-d1e418eda803 tempest-GroupSnapshotsV319Test-1643047642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.dc3ef3fb-5634-4268-afc6-0e3b7ce1186d" returned: 0 in 0.436s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1acb6697-e355-4623-ae8d-d1e418eda803 tempest-GroupSnapshotsV319Test-1643047642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:04 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.info Jul 22 12:14:04 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:04 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1acb6697-e355-4623-ae8d-d1e418eda803 tempest-GroupSnapshotsV319Test-1643047642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.info" returned: 0 in 0.317s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:04 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-1acb6697-e355-4623-ae8d-d1e418eda803 tempest-GroupSnapshotsV319Test-1643047642 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 12:14:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1acb6697-e355-4623-ae8d-d1e418eda803 tempest-GroupSnapshotsV319Test-1643047642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:04 devstack sudo[94623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.info Jul 22 12:14:04 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:04 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1acb6697-e355-4623-ae8d-d1e418eda803 tempest-GroupSnapshotsV319Test-1643047642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.info" returned: 0 in 0.327s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1acb6697-e355-4623-ae8d-d1e418eda803 tempest-GroupSnapshotsV319Test-1643047642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.977s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:04 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-1acb6697-e355-4623-ae8d-d1e418eda803 tempest-GroupSnapshotsV319Test-1643047642 None] group_snapshot af9e121b-22ec-498d-b64c-abfb94d89792: created successfully Jul 22 12:14:05 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] group_snapshot af9e121b-22ec-498d-b64c-abfb94d89792: deleting Jul 22 12:14:05 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] group_snapshot af9e121b-22ec-498d-b64c-abfb94d89792: deleting {{(pid=87568) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 22 12:14:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] Acquiring lock "cinder-quobyte-2706ce42-f374-4e46-bea0-e61891e80055" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] Lock "cinder-quobyte-2706ce42-f374-4e46-bea0-e61891e80055" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] Acquiring lock "cinder-quobyte-dc3ef3fb-5634-4268-afc6-0e3b7ce1186d" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] Lock "cinder-quobyte-dc3ef3fb-5634-4268-afc6-0e3b7ce1186d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:05 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] Deleting offline snapshot dc3ef3fb-5634-4268-afc6-0e3b7ce1186d of volume 2706ce42-f374-4e46-bea0-e61891e80055 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:14:05 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] snapshot_file for this snap is: volume-2706ce42-f374-4e46-bea0-e61891e80055.dc3ef3fb-5634-4268-afc6-0e3b7ce1186d {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:14:05 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8667b7-24d5-4d9b-bcfb-680275d55cc6]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:14:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.dc3ef3fb-5634-4268-afc6-0e3b7ce1186d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:05 devstack sudo[94626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.dc3ef3fb-5634-4268-afc6-0e3b7ce1186d Jul 22 12:14:05 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:06 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.dc3ef3fb-5634-4268-afc6-0e3b7ce1186d" returned: 0 in 0.442s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2706ce42-f374-4e46-bea0-e61891e80055(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[007f0177-5c0b-4b67-b4e2-07374ad38f77]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:06 devstack sudo[94632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055 Jul 22 12:14:06 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:06 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055" returned: 0 in 0.502s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.dc3ef3fb-5634-4268-afc6-0e3b7ce1186d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:06 devstack sudo[94640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.dc3ef3fb-5634-4268-afc6-0e3b7ce1186d Jul 22 12:14:06 devstack sudo[94640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Flow 'volume_create_manager' (855d3bc8-66cb-47c8-8096-657daa99cfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae0bfb3-bf46-4ec7-bb8c-5fe6864f9e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae0bfb3-bf46-4ec7-bb8c-5fe6864f9e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-121816508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec0b010-f94c-4e3e-b55f-9110da70953f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='57e0ae68cfc542c0acb41485dca0a66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:14:07Z,use_quota=True,user_id='690d54b8ad084cc2b1125c6e888a90d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df66407b-9ddd-40fa-b9de-d6075925f326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df66407b-9ddd-40fa-b9de-d6075925f326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de885e86-943d-429b-84f7-e02f8ec5155a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de885e86-943d-429b-84f7-e02f8ec5155a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ec0b010-f94c-4e3e-b55f-9110da70953f', 'volume_name': 'volume-3ec0b010-f94c-4e3e-b55f-9110da70953f', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a276bfce-a3d4-4ba7-8548-41568d6192e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a276bfce-a3d4-4ba7-8548-41568d6192e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ebc2f4b-34a6-4b89-a706-62a712738ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:06 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Volume 3ec0b010-f94c-4e3e-b55f-9110da70953f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ec0b010-f94c-4e3e-b55f-9110da70953f', 'volume_size': 1} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-121816508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec0b010-f94c-4e3e-b55f-9110da70953f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='57e0ae68cfc542c0acb41485dca0a66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:14:07Z,use_quota=True,user_id='690d54b8ad084cc2b1125c6e888a90d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Creating volume 3ec0b010-f94c-4e3e-b55f-9110da70953f {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:14:06 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:14:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3ec0b010-f94c-4e3e-b55f-9110da70953f 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:06 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3ec0b010-f94c-4e3e-b55f-9110da70953f 1073741824 Jul 22 12:14:06 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:07 devstack sudo[94640]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.dc3ef3fb-5634-4268-afc6-0e3b7ce1186d" returned: 0 in 0.413s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.dc3ef3fb-5634-4268-afc6-0e3b7ce1186d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:07 devstack sudo[94652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.dc3ef3fb-5634-4268-afc6-0e3b7ce1186d Jul 22 12:14:07 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:07 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3ec0b010-f94c-4e3e-b55f-9110da70953f 1073741824" returned: 0 in 0.506s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:07 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3ec0b010-f94c-4e3e-b55f-9110da70953f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055.dc3ef3fb-5634-4268-afc6-0e3b7ce1186d" returned: 0 in 0.304s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:07 devstack sudo[94657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3ec0b010-f94c-4e3e-b55f-9110da70953f Jul 22 12:14:07 devstack sudo[94657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] Lock "cinder-quobyte-dc3ef3fb-5634-4268-afc6-0e3b7ce1186d" released by "_delete_snapshot" :: held 1.790s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:14:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] Lock "cinder-quobyte-2706ce42-f374-4e46-bea0-e61891e80055" released by "delete_snapshot" :: held 1.823s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:14:07 devstack cinder-volume[87568]: WARNING cinder.quota [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-631812044 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-631812044, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:14:07 devstack cinder-volume[87568]: WARNING cinder.quota [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-631812044 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-631812044, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:14:07 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] Created reservations ['cb793320-89af-4ea8-86f0-2e791d7cdac9', '7e89af14-8753-4678-92ae-a2950955fa94', 'c6d0db1f-2b93-4b7c-8270-9db7cf8cb800', '274a1087-cb44-4d4d-94e8-664f3420fda2'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:14:07 devstack sudo[94657]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3ec0b010-f94c-4e3e-b55f-9110da70953f" returned: 0 in 0.316s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:14:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ebc2f4b-34a6-4b89-a706-62a712738ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ec0b010-f94c-4e3e-b55f-9110da70953f', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35485db7-e2ff-40cc-a77c-f03793e09bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:07 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-12b6bdaf-d9f5-4425-8948-91d7a6713068 tempest-GroupSnapshotsV319Test-1643047642 None] group_snapshot af9e121b-22ec-498d-b64c-abfb94d89792: deleted successfully Jul 22 12:14:07 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Volume volume-3ec0b010-f94c-4e3e-b55f-9110da70953f (3ec0b010-f94c-4e3e-b55f-9110da70953f): created successfully Jul 22 12:14:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35485db7-e2ff-40cc-a77c-f03793e09bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Flow 'volume_create_manager' (855d3bc8-66cb-47c8-8096-657daa99cfce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:14:07 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-a1b15ca3-4f2b-49c9-b7fd-28b9c5c6b7fb req-040ebdc7-b3e5-4ed2-81f1-cfa3c9da844e tempest-VolumesGetTestJSON-1532541617 None] Created volume successfully. Jul 22 12:14:08 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a3e33822-78a0-435a-97fd-fe7e4ec61b66 tempest-GroupSnapshotsV319Test-1643047642 None] Acquiring lock "cinder-quobyte-2706ce42-f374-4e46-bea0-e61891e80055" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:08 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a3e33822-78a0-435a-97fd-fe7e4ec61b66 tempest-GroupSnapshotsV319Test-1643047642 None] Lock "cinder-quobyte-2706ce42-f374-4e46-bea0-e61891e80055" acquired by "delete_volume" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:08 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4f9d8e-7d76-41d4-a0e7-627635a3dcc3]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:14:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a3e33822-78a0-435a-97fd-fe7e4ec61b66 tempest-GroupSnapshotsV319Test-1643047642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:08 devstack sudo[94671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055 Jul 22 12:14:08 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:08 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a3e33822-78a0-435a-97fd-fe7e4ec61b66 tempest-GroupSnapshotsV319Test-1643047642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055" returned: 0 in 0.598s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a3e33822-78a0-435a-97fd-fe7e4ec61b66 tempest-GroupSnapshotsV319Test-1643047642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:09 devstack sudo[94682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055 Jul 22 12:14:09 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:09 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a3e33822-78a0-435a-97fd-fe7e4ec61b66 tempest-GroupSnapshotsV319Test-1643047642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2706ce42-f374-4e46-bea0-e61891e80055" returned: 0 in 0.370s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:09 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-e973c180-1db3-47ed-83b3-1e7986b79cba req-eafddf9e-4a3b-4f0b-b49c-a12740204972 tempest-VolumesGetTestJSON-1532541617 None] Acquiring lock "cinder-3ec0b010-f94c-4e3e-b55f-9110da70953f-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:09 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a3e33822-78a0-435a-97fd-fe7e4ec61b66 tempest-GroupSnapshotsV319Test-1643047642 None] Lock "cinder-quobyte-2706ce42-f374-4e46-bea0-e61891e80055" released by "delete_volume" :: held 1.068s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:14:09 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-e973c180-1db3-47ed-83b3-1e7986b79cba req-eafddf9e-4a3b-4f0b-b49c-a12740204972 tempest-VolumesGetTestJSON-1532541617 None] Lock "cinder-3ec0b010-f94c-4e3e-b55f-9110da70953f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:09 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-e973c180-1db3-47ed-83b3-1e7986b79cba req-eafddf9e-4a3b-4f0b-b49c-a12740204972 tempest-VolumesGetTestJSON-1532541617 None] Acquiring lock "cinder-quobyte-3ec0b010-f94c-4e3e-b55f-9110da70953f" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:09 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-a3e33822-78a0-435a-97fd-fe7e4ec61b66 tempest-GroupSnapshotsV319Test-1643047642 None] Created reservations ['83149806-51ac-4be3-ba3b-1d4c475fa914'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:14:09 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-e973c180-1db3-47ed-83b3-1e7986b79cba req-eafddf9e-4a3b-4f0b-b49c-a12740204972 tempest-VolumesGetTestJSON-1532541617 None] Lock "cinder-quobyte-3ec0b010-f94c-4e3e-b55f-9110da70953f" acquired by "delete_volume" :: waited 0.034s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:09 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb9a1f0-a6df-4c4d-a053-149ad6438093]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:14:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-e973c180-1db3-47ed-83b3-1e7986b79cba req-eafddf9e-4a3b-4f0b-b49c-a12740204972 tempest-VolumesGetTestJSON-1532541617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3ec0b010-f94c-4e3e-b55f-9110da70953f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:09 devstack cinder-volume[87568]: WARNING cinder.quota [None req-a3e33822-78a0-435a-97fd-fe7e4ec61b66 tempest-GroupSnapshotsV319Test-1643047642 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-631812044 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-631812044, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:14:09 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-a3e33822-78a0-435a-97fd-fe7e4ec61b66 tempest-GroupSnapshotsV319Test-1643047642 None] Created reservations ['66e5f69d-24bf-4f29-a3ad-f04bf5b9d1cb', '566df434-72f5-4b82-9895-3bdc40982562', '885cc5c0-c26f-44b4-b303-ec946929b142', 'bcdfe335-3766-4f18-9879-81f5d15938a2'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:14:09 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3ec0b010-f94c-4e3e-b55f-9110da70953f Jul 22 12:14:09 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a3e33822-78a0-435a-97fd-fe7e4ec61b66 tempest-GroupSnapshotsV319Test-1643047642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a3e33822-78a0-435a-97fd-fe7e4ec61b66 tempest-GroupSnapshotsV319Test-1643047642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:09 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a3e33822-78a0-435a-97fd-fe7e4ec61b66 tempest-GroupSnapshotsV319Test-1643047642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:09 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a3e33822-78a0-435a-97fd-fe7e4ec61b66 tempest-GroupSnapshotsV319Test-1643047642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a3e33822-78a0-435a-97fd-fe7e4ec61b66 tempest-GroupSnapshotsV319Test-1643047642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a3e33822-78a0-435a-97fd-fe7e4ec61b66 tempest-GroupSnapshotsV319Test-1643047642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:09 devstack sudo[94690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:14:09 devstack sudo[94690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:10 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-bdddf126-03d5-46b8-9526-bceaa651e632 req-01a3583a-9589-4de7-850e-45257e7fdb4b tempest-ServerActionsTestOtherA-869975188 None] Terminate volume connection completed successfully. Jul 22 12:14:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-bdddf126-03d5-46b8-9526-bceaa651e632 req-01a3583a-9589-4de7-850e-45257e7fdb4b tempest-ServerActionsTestOtherA-869975188 None] Deleting attachment 8484c9a9-f641-4002-b5c3-7e1982e99d9b. {{(pid=87568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 12:14:10 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-e973c180-1db3-47ed-83b3-1e7986b79cba req-eafddf9e-4a3b-4f0b-b49c-a12740204972 tempest-VolumesGetTestJSON-1532541617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3ec0b010-f94c-4e3e-b55f-9110da70953f" returned: 0 in 0.560s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-e973c180-1db3-47ed-83b3-1e7986b79cba req-eafddf9e-4a3b-4f0b-b49c-a12740204972 tempest-VolumesGetTestJSON-1532541617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3ec0b010-f94c-4e3e-b55f-9110da70953f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:10 devstack sudo[94690]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a3e33822-78a0-435a-97fd-fe7e4ec61b66 tempest-GroupSnapshotsV319Test-1643047642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.337s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:10 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-a3e33822-78a0-435a-97fd-fe7e4ec61b66 tempest-GroupSnapshotsV319Test-1643047642 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:14:10 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-a3e33822-78a0-435a-97fd-fe7e4ec61b66 tempest-GroupSnapshotsV319Test-1643047642 None] Delete group completed successfully. Jul 22 12:14:10 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3ec0b010-f94c-4e3e-b55f-9110da70953f Jul 22 12:14:10 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:10 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-e973c180-1db3-47ed-83b3-1e7986b79cba req-eafddf9e-4a3b-4f0b-b49c-a12740204972 tempest-VolumesGetTestJSON-1532541617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3ec0b010-f94c-4e3e-b55f-9110da70953f" returned: 0 in 0.313s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:10 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-e973c180-1db3-47ed-83b3-1e7986b79cba req-eafddf9e-4a3b-4f0b-b49c-a12740204972 tempest-VolumesGetTestJSON-1532541617 None] Lock "cinder-quobyte-3ec0b010-f94c-4e3e-b55f-9110da70953f" released by "delete_volume" :: held 0.931s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:14:10 devstack cinder-volume[87568]: DEBUG cinder.quota [req-e973c180-1db3-47ed-83b3-1e7986b79cba req-eafddf9e-4a3b-4f0b-b49c-a12740204972 tempest-VolumesGetTestJSON-1532541617 None] Created reservations ['83292fee-da10-4ce4-9f95-ec6d0efd67d4', '81bdd234-a0bd-4df7-96e8-98113a797a2f', '083a7b11-d342-4a1c-805b-a3d434e5e4b7', 'd200c3e6-4ede-43d8-8fc0-b94529917830'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:14:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-e973c180-1db3-47ed-83b3-1e7986b79cba req-eafddf9e-4a3b-4f0b-b49c-a12740204972 tempest-VolumesGetTestJSON-1532541617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-e973c180-1db3-47ed-83b3-1e7986b79cba req-eafddf9e-4a3b-4f0b-b49c-a12740204972 tempest-VolumesGetTestJSON-1532541617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:10 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [req-e973c180-1db3-47ed-83b3-1e7986b79cba req-eafddf9e-4a3b-4f0b-b49c-a12740204972 tempest-VolumesGetTestJSON-1532541617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:10 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [req-e973c180-1db3-47ed-83b3-1e7986b79cba req-eafddf9e-4a3b-4f0b-b49c-a12740204972 tempest-VolumesGetTestJSON-1532541617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-e973c180-1db3-47ed-83b3-1e7986b79cba req-eafddf9e-4a3b-4f0b-b49c-a12740204972 tempest-VolumesGetTestJSON-1532541617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-e973c180-1db3-47ed-83b3-1e7986b79cba req-eafddf9e-4a3b-4f0b-b49c-a12740204972 tempest-VolumesGetTestJSON-1532541617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:10 devstack sudo[94704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:14:10 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:10 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-e973c180-1db3-47ed-83b3-1e7986b79cba req-eafddf9e-4a3b-4f0b-b49c-a12740204972 tempest-VolumesGetTestJSON-1532541617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.328s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:10 devstack cinder-volume[87568]: DEBUG cinder.manager [req-e973c180-1db3-47ed-83b3-1e7986b79cba req-eafddf9e-4a3b-4f0b-b49c-a12740204972 tempest-VolumesGetTestJSON-1532541617 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:14:10 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-e973c180-1db3-47ed-83b3-1e7986b79cba req-eafddf9e-4a3b-4f0b-b49c-a12740204972 tempest-VolumesGetTestJSON-1532541617 None] Deleted volume successfully. Jul 22 12:14:11 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-e973c180-1db3-47ed-83b3-1e7986b79cba req-eafddf9e-4a3b-4f0b-b49c-a12740204972 tempest-VolumesGetTestJSON-1532541617 None] Lock "cinder-3ec0b010-f94c-4e3e-b55f-9110da70953f-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:14:17 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6f206b93-8c6e-4a0a-8b9c-64749d66d6b0 tempest-ServerActionsTestOtherA-869975188 None] Acquiring lock "cinder-85086688-3d97-480b-93c1-e5f3f196e54a-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:17 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6f206b93-8c6e-4a0a-8b9c-64749d66d6b0 tempest-ServerActionsTestOtherA-869975188 None] Lock "cinder-85086688-3d97-480b-93c1-e5f3f196e54a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:17 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6f206b93-8c6e-4a0a-8b9c-64749d66d6b0 tempest-ServerActionsTestOtherA-869975188 None] Acquiring lock "cinder-quobyte-85086688-3d97-480b-93c1-e5f3f196e54a" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:17 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6f206b93-8c6e-4a0a-8b9c-64749d66d6b0 tempest-ServerActionsTestOtherA-869975188 None] Lock "cinder-quobyte-85086688-3d97-480b-93c1-e5f3f196e54a" acquired by "delete_volume" :: waited 0.030s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:18 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f047513-585b-42e9-aa7b-a1a10e2699f4]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:14:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6f206b93-8c6e-4a0a-8b9c-64749d66d6b0 tempest-ServerActionsTestOtherA-869975188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-85086688-3d97-480b-93c1-e5f3f196e54a {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:18 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-85086688-3d97-480b-93c1-e5f3f196e54a Jul 22 12:14:18 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:18 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6f206b93-8c6e-4a0a-8b9c-64749d66d6b0 tempest-ServerActionsTestOtherA-869975188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-85086688-3d97-480b-93c1-e5f3f196e54a" returned: 0 in 0.689s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6f206b93-8c6e-4a0a-8b9c-64749d66d6b0 tempest-ServerActionsTestOtherA-869975188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-85086688-3d97-480b-93c1-e5f3f196e54a {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:18 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-85086688-3d97-480b-93c1-e5f3f196e54a Jul 22 12:14:18 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:19 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6f206b93-8c6e-4a0a-8b9c-64749d66d6b0 tempest-ServerActionsTestOtherA-869975188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-85086688-3d97-480b-93c1-e5f3f196e54a" returned: 0 in 0.554s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6f206b93-8c6e-4a0a-8b9c-64749d66d6b0 tempest-ServerActionsTestOtherA-869975188 None] Lock "cinder-quobyte-85086688-3d97-480b-93c1-e5f3f196e54a" released by "delete_volume" :: held 1.339s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-6f206b93-8c6e-4a0a-8b9c-64749d66d6b0 tempest-ServerActionsTestOtherA-869975188 None] Created reservations ['816dd35f-4083-44bc-9cdf-59fecfd6a8ac', '2601c270-df8a-415e-8821-a11b07bf3ba5', 'af3ada7d-9fbf-4f04-b722-8a932da10afd', '40c75f71-947a-414e-bc72-8b10ae1927eb'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6f206b93-8c6e-4a0a-8b9c-64749d66d6b0 tempest-ServerActionsTestOtherA-869975188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6f206b93-8c6e-4a0a-8b9c-64749d66d6b0 tempest-ServerActionsTestOtherA-869975188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6f206b93-8c6e-4a0a-8b9c-64749d66d6b0 tempest-ServerActionsTestOtherA-869975188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6f206b93-8c6e-4a0a-8b9c-64749d66d6b0 tempest-ServerActionsTestOtherA-869975188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6f206b93-8c6e-4a0a-8b9c-64749d66d6b0 tempest-ServerActionsTestOtherA-869975188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6f206b93-8c6e-4a0a-8b9c-64749d66d6b0 tempest-ServerActionsTestOtherA-869975188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:19 devstack sudo[94845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:14:19 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Flow 'volume_create_manager' (1bf4acb4-fef5-47fb-a90f-689cd086680b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f87d06-b25c-4fc3-97e7-e106d1072355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f87d06-b25c-4fc3-97e7-e106d1072355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1165546328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420090ce-860c-446b-b09e-f4990c2487e8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04a116eb5a75402394d664b537fad8f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:14:20Z,use_quota=True,user_id='6fdb2a0039da4bfe9e720cf27812c3cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d06fca0-81c9-4f88-b266-5292d44d1fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d06fca0-81c9-4f88-b266-5292d44d1fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10dfe152-a961-4238-ab5a-4760b83e1fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10dfe152-a961-4238-ab5a-4760b83e1fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '420090ce-860c-446b-b09e-f4990c2487e8', 'volume_name': 'volume-420090ce-860c-446b-b09e-f4990c2487e8', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3f69a3d-8600-414e-a952-f2ef58204f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3f69a3d-8600-414e-a952-f2ef58204f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf2fea0-7e03-4ec4-bfd9-4b522fcafc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:19 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Volume 420090ce-860c-446b-b09e-f4990c2487e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-420090ce-860c-446b-b09e-f4990c2487e8', 'volume_size': 1} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1165546328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420090ce-860c-446b-b09e-f4990c2487e8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04a116eb5a75402394d664b537fad8f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:14:20Z,use_quota=True,user_id='6fdb2a0039da4bfe9e720cf27812c3cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Creating volume 420090ce-860c-446b-b09e-f4990c2487e8 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:14:19 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:14:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-420090ce-860c-446b-b09e-f4990c2487e8 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:19 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-420090ce-860c-446b-b09e-f4990c2487e8 1073741824 Jul 22 12:14:19 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:20 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6f206b93-8c6e-4a0a-8b9c-64749d66d6b0 tempest-ServerActionsTestOtherA-869975188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.461s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:20 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-6f206b93-8c6e-4a0a-8b9c-64749d66d6b0 tempest-ServerActionsTestOtherA-869975188 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:14:20 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-6f206b93-8c6e-4a0a-8b9c-64749d66d6b0 tempest-ServerActionsTestOtherA-869975188 None] Deleted volume successfully. Jul 22 12:14:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6f206b93-8c6e-4a0a-8b9c-64749d66d6b0 tempest-ServerActionsTestOtherA-869975188 None] Lock "cinder-85086688-3d97-480b-93c1-e5f3f196e54a-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:14:20 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-420090ce-860c-446b-b09e-f4990c2487e8 1073741824" returned: 0 in 0.729s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-420090ce-860c-446b-b09e-f4990c2487e8 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:20 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-420090ce-860c-446b-b09e-f4990c2487e8 Jul 22 12:14:20 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:21 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-420090ce-860c-446b-b09e-f4990c2487e8" returned: 0 in 0.415s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:14:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf2fea0-7e03-4ec4-bfd9-4b522fcafc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-420090ce-860c-446b-b09e-f4990c2487e8', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aff4433-d428-4847-8ddc-d4f264e2abfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:21 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Volume volume-420090ce-860c-446b-b09e-f4990c2487e8 (420090ce-860c-446b-b09e-f4990c2487e8): created successfully Jul 22 12:14:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aff4433-d428-4847-8ddc-d4f264e2abfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Flow 'volume_create_manager' (1bf4acb4-fef5-47fb-a90f-689cd086680b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:14:21 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-4fd760ff-eb0f-4438-987d-32bdea80e822 tempest-VolumesTestJSON-324111431 None] Created volume successfully. Jul 22 12:14:21 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b91b2789-14f2-4fde-8c43-7b3f8ef1062e tempest-GroupsTest-1887415166 None] Group tempest-Group1-540685548: creating Jul 22 12:14:21 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b91b2789-14f2-4fde-8c43-7b3f8ef1062e tempest-GroupsTest-1887415166 None] Group tempest-Group1-540685548: created successfully Jul 22 12:14:21 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b91b2789-14f2-4fde-8c43-7b3f8ef1062e tempest-GroupsTest-1887415166 None] Create group completed successfully. Jul 22 12:14:22 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:14:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Flow 'volume_create_manager' (5f37bc38-434f-4039-b77f-5bef75ab144c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:14:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f1dee0-7d84-46e3-aaff-3c51fd0e6c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f1dee0-7d84-46e3-aaff-3c51fd0e6c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1465264972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19af195f-41b0-4f63-b561-bc11d874e7f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04a116eb5a75402394d664b537fad8f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:14:22Z,use_quota=True,user_id='6fdb2a0039da4bfe9e720cf27812c3cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0511909e-7d66-424d-ae67-7238d96ff670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0511909e-7d66-424d-ae67-7238d96ff670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19af779c-66c1-46fe-b331-2b5b20733f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19af779c-66c1-46fe-b331-2b5b20733f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19af195f-41b0-4f63-b561-bc11d874e7f9', 'volume_name': 'volume-19af195f-41b0-4f63-b561-bc11d874e7f9', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0315ddb-95de-46bc-ae38-b98ac2100b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0315ddb-95de-46bc-ae38-b98ac2100b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9a7bfc-40a4-4fe9-94ed-78c7ea95055c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:22 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Volume 19af195f-41b0-4f63-b561-bc11d874e7f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19af195f-41b0-4f63-b561-bc11d874e7f9', 'volume_size': 1} Jul 22 12:14:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1465264972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19af195f-41b0-4f63-b561-bc11d874e7f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04a116eb5a75402394d664b537fad8f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:14:22Z,use_quota=True,user_id='6fdb2a0039da4bfe9e720cf27812c3cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:14:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Creating volume 19af195f-41b0-4f63-b561-bc11d874e7f9 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:14:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:14:22 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:14:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19af195f-41b0-4f63-b561-bc11d874e7f9 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:22 devstack sudo[94882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19af195f-41b0-4f63-b561-bc11d874e7f9 1073741824 Jul 22 12:14:22 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:23 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-7174f636-ffbe-42b1-aeb1-a65fc51d2b33 tempest-GroupsTest-1887415166 None] Group tempest-Group2-1391010632: creating Jul 22 12:14:23 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19af195f-41b0-4f63-b561-bc11d874e7f9 1073741824" returned: 0 in 0.721s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:23 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-7174f636-ffbe-42b1-aeb1-a65fc51d2b33 tempest-GroupsTest-1887415166 None] Group tempest-Group2-1391010632: created successfully Jul 22 12:14:23 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-7174f636-ffbe-42b1-aeb1-a65fc51d2b33 tempest-GroupsTest-1887415166 None] Create group completed successfully. Jul 22 12:14:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19af195f-41b0-4f63-b561-bc11d874e7f9 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:23 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19af195f-41b0-4f63-b561-bc11d874e7f9 Jul 22 12:14:23 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:23 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19af195f-41b0-4f63-b561-bc11d874e7f9" returned: 0 in 0.330s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:14:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9a7bfc-40a4-4fe9-94ed-78c7ea95055c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19af195f-41b0-4f63-b561-bc11d874e7f9', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c58ec2-0111-4c88-8a01-426b973b7797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:23 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Volume volume-19af195f-41b0-4f63-b561-bc11d874e7f9 (19af195f-41b0-4f63-b561-bc11d874e7f9): created successfully Jul 22 12:14:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c58ec2-0111-4c88-8a01-426b973b7797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Flow 'volume_create_manager' (5f37bc38-434f-4039-b77f-5bef75ab144c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:14:23 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-619b89a8-7cc4-4793-bf36-64271bec3376 tempest-VolumesTestJSON-324111431 None] Created volume successfully. Jul 22 12:14:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:14:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:24 devstack sudo[94892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:14:24 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:24 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.412s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:24 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:14:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:14:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread count: 8 {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:14:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread info: [<_MainThread(MainThread, started 137793405739136)>, , , , , , , ] {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Flow 'volume_create_manager' (6a0e4dd1-b19d-471c-b765-f9799e5bfd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0afea6f1-1d09-4984-a6cb-303cb3abcea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0afea6f1-1d09-4984-a6cb-303cb3abcea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-418982382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e52dc8d-4e85-4978-ab06-4402c600783a,host='devstack@QuobyteHD#QuobyteHD',id=58819d9c-e885-451c-988f-a5b2704d5ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7e7e810c904ced8fa0f8b85457cd74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:14:25Z,use_quota=True,user_id='ba17b6658cea41a6a67a9bd7ab1f84ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43829212-f349-4894-b7d0-043e2308d0c4),volume_type_id=43829212-f349-4894-b7d0-043e2308d0c4)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f671a291-34cd-4f1f-9267-ca10858e213b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f671a291-34cd-4f1f-9267-ca10858e213b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a11605-629f-454d-8746-b37eca271178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a11605-629f-454d-8746-b37eca271178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58819d9c-e885-451c-988f-a5b2704d5ac6', 'volume_name': 'volume-58819d9c-e885-451c-988f-a5b2704d5ac6', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e427c316-83c1-4cbb-aad1-7febdc040e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e427c316-83c1-4cbb-aad1-7febdc040e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a06b4a49-ced1-482e-8095-072a9155dbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:25 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Volume 58819d9c-e885-451c-988f-a5b2704d5ac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58819d9c-e885-451c-988f-a5b2704d5ac6', 'volume_size': 1} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0e52dc8d-4e85-4978-ab06-4402c600783a,created_at=2026-07-22T10:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-418982382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e52dc8d-4e85-4978-ab06-4402c600783a,host='devstack@QuobyteHD#QuobyteHD',id=58819d9c-e885-451c-988f-a5b2704d5ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7e7e810c904ced8fa0f8b85457cd74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:14:25Z,use_quota=True,user_id='ba17b6658cea41a6a67a9bd7ab1f84ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43829212-f349-4894-b7d0-043e2308d0c4),volume_type_id=43829212-f349-4894-b7d0-043e2308d0c4)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Creating volume 58819d9c-e885-451c-988f-a5b2704d5ac6 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:14:25 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58819d9c-e885-451c-988f-a5b2704d5ac6 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:25 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58819d9c-e885-451c-988f-a5b2704d5ac6 1073741824 Jul 22 12:14:25 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Flow 'volume_create_manager' (b3d7ed94-cfd8-4ff0-8796-714ef7ddf29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b8a238-4e3d-4df1-b976-9764ba5f6e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b8a238-4e3d-4df1-b976-9764ba5f6e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1830338760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04a116eb5a75402394d664b537fad8f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:14:26Z,use_quota=True,user_id='6fdb2a0039da4bfe9e720cf27812c3cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a142c53-3ca1-40cc-9460-c2a89f5b8ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a142c53-3ca1-40cc-9460-c2a89f5b8ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08653d5d-f739-492d-b724-c21f2c883f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08653d5d-f739-492d-b724-c21f2c883f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428', 'volume_name': 'volume-3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d800dc50-285b-47a4-a91e-aa1b6842147b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d800dc50-285b-47a4-a91e-aa1b6842147b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03582d36-1e14-4410-98eb-077c551a1b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:25 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Volume 3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428', 'volume_size': 1} Jul 22 12:14:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:26 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58819d9c-e885-451c-988f-a5b2704d5ac6 1073741824" returned: 0 in 0.609s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58819d9c-e885-451c-988f-a5b2704d5ac6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:26 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58819d9c-e885-451c-988f-a5b2704d5ac6 Jul 22 12:14:26 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:26 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58819d9c-e885-451c-988f-a5b2704d5ac6" returned: 0 in 0.276s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:14:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.579s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1830338760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04a116eb5a75402394d664b537fad8f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:14:26Z,use_quota=True,user_id='6fdb2a0039da4bfe9e720cf27812c3cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:14:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Creating volume 3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:14:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:14:26 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:14:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a06b4a49-ced1-482e-8095-072a9155dbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58819d9c-e885-451c-988f-a5b2704d5ac6', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367adf02-5761-42ae-8db6-19efe7da73aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:26 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428 1073741824 Jul 22 12:14:26 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:26 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Volume volume-58819d9c-e885-451c-988f-a5b2704d5ac6 (58819d9c-e885-451c-988f-a5b2704d5ac6): created successfully Jul 22 12:14:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367adf02-5761-42ae-8db6-19efe7da73aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Flow 'volume_create_manager' (6a0e4dd1-b19d-471c-b765-f9799e5bfd90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:14:26 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-ae196fd3-8223-4281-b29b-b7b37afd676d tempest-GroupsTest-1887415166 None] Created volume successfully. Jul 22 12:14:26 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428 1073741824" returned: 0 in 0.539s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:26 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428 Jul 22 12:14:26 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:27 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428" returned: 0 in 0.270s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:27 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:14:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03582d36-1e14-4410-98eb-077c551a1b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b50cf0-9daa-449d-a100-aa8096cc0db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:27 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Volume volume-3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428 (3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428): created successfully Jul 22 12:14:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b50cf0-9daa-449d-a100-aa8096cc0db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Flow 'volume_create_manager' (b3d7ed94-cfd8-4ff0-8796-714ef7ddf29d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:14:27 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-5f8a5e74-183f-4d88-970f-42c30dd165bc tempest-VolumesTestJSON-324111431 None] Created volume successfully. Jul 22 12:14:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-35071f13-b0be-4050-b548-d5daf1382556 tempest-GroupsTest-1887415166 None] Acquiring lock "cinder-quobyte-58819d9c-e885-451c-988f-a5b2704d5ac6" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-35071f13-b0be-4050-b548-d5daf1382556 tempest-GroupsTest-1887415166 None] Lock "cinder-quobyte-58819d9c-e885-451c-988f-a5b2704d5ac6" acquired by "delete_volume" :: waited 0.022s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:27 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[52734bd1-8e50-4584-b46a-842a49aaf453]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:14:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-35071f13-b0be-4050-b548-d5daf1382556 tempest-GroupsTest-1887415166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58819d9c-e885-451c-988f-a5b2704d5ac6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:27 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58819d9c-e885-451c-988f-a5b2704d5ac6 Jul 22 12:14:27 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:27 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-35071f13-b0be-4050-b548-d5daf1382556 tempest-GroupsTest-1887415166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58819d9c-e885-451c-988f-a5b2704d5ac6" returned: 0 in 0.449s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-35071f13-b0be-4050-b548-d5daf1382556 tempest-GroupsTest-1887415166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58819d9c-e885-451c-988f-a5b2704d5ac6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:27 devstack sudo[94937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58819d9c-e885-451c-988f-a5b2704d5ac6 Jul 22 12:14:27 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:28 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-35071f13-b0be-4050-b548-d5daf1382556 tempest-GroupsTest-1887415166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58819d9c-e885-451c-988f-a5b2704d5ac6" returned: 0 in 0.280s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-35071f13-b0be-4050-b548-d5daf1382556 tempest-GroupsTest-1887415166 None] Lock "cinder-quobyte-58819d9c-e885-451c-988f-a5b2704d5ac6" released by "delete_volume" :: held 0.781s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-35071f13-b0be-4050-b548-d5daf1382556 tempest-GroupsTest-1887415166 None] Created reservations ['a41ecb5d-32af-4074-93bb-76db510eb287'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:14:28 devstack cinder-volume[87568]: WARNING cinder.quota [None req-35071f13-b0be-4050-b548-d5daf1382556 tempest-GroupsTest-1887415166 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1328645756 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1328645756, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:14:28 devstack cinder-volume[87568]: WARNING cinder.quota [None req-35071f13-b0be-4050-b548-d5daf1382556 tempest-GroupsTest-1887415166 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1328645756 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1328645756, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-35071f13-b0be-4050-b548-d5daf1382556 tempest-GroupsTest-1887415166 None] Created reservations ['4e705712-03f5-4422-b6d6-3f5d575a04d1', 'a0afe0af-3419-4a99-99a8-a2532e3989b2', '0414f02f-3d85-4dbf-bc0f-8660ff9af1f3', '855fa774-5003-4914-8007-1b77920da489'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-35071f13-b0be-4050-b548-d5daf1382556 tempest-GroupsTest-1887415166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-35071f13-b0be-4050-b548-d5daf1382556 tempest-GroupsTest-1887415166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-35071f13-b0be-4050-b548-d5daf1382556 tempest-GroupsTest-1887415166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-35071f13-b0be-4050-b548-d5daf1382556 tempest-GroupsTest-1887415166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-35071f13-b0be-4050-b548-d5daf1382556 tempest-GroupsTest-1887415166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-35071f13-b0be-4050-b548-d5daf1382556 tempest-GroupsTest-1887415166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:28 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:14:28 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:28 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-1a070aa7-9ee2-4446-a065-2555f7cee826 tempest-GroupsTest-1887415166 None] Created reservations ['d53c2fc4-178c-4974-b00c-0294831829d3'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-35071f13-b0be-4050-b548-d5daf1382556 tempest-GroupsTest-1887415166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.378s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-35071f13-b0be-4050-b548-d5daf1382556 tempest-GroupsTest-1887415166 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:14:28 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-35071f13-b0be-4050-b548-d5daf1382556 tempest-GroupsTest-1887415166 None] Delete group completed successfully. Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1a070aa7-9ee2-4446-a065-2555f7cee826 tempest-GroupsTest-1887415166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1a070aa7-9ee2-4446-a065-2555f7cee826 tempest-GroupsTest-1887415166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1a070aa7-9ee2-4446-a065-2555f7cee826 tempest-GroupsTest-1887415166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1a070aa7-9ee2-4446-a065-2555f7cee826 tempest-GroupsTest-1887415166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1a070aa7-9ee2-4446-a065-2555f7cee826 tempest-GroupsTest-1887415166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1a070aa7-9ee2-4446-a065-2555f7cee826 tempest-GroupsTest-1887415166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:28 devstack sudo[94943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:14:28 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a9ed6764-8b4b-4347-a094-caa6dbd0fbf5 tempest-VolumesTestJSON-324111431 None] Acquiring lock "cinder-3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a9ed6764-8b4b-4347-a094-caa6dbd0fbf5 tempest-VolumesTestJSON-324111431 None] Lock "cinder-3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a9ed6764-8b4b-4347-a094-caa6dbd0fbf5 tempest-VolumesTestJSON-324111431 None] Acquiring lock "cinder-quobyte-3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a9ed6764-8b4b-4347-a094-caa6dbd0fbf5 tempest-VolumesTestJSON-324111431 None] Lock "cinder-quobyte-3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428" acquired by "delete_volume" :: waited 0.021s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[93519b03-c7f6-42bd-8688-bbde66fea61b]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:14:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a9ed6764-8b4b-4347-a094-caa6dbd0fbf5 tempest-VolumesTestJSON-324111431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:29 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1a070aa7-9ee2-4446-a065-2555f7cee826 tempest-GroupsTest-1887415166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.342s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:29 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-1a070aa7-9ee2-4446-a065-2555f7cee826 tempest-GroupsTest-1887415166 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:14:29 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-1a070aa7-9ee2-4446-a065-2555f7cee826 tempest-GroupsTest-1887415166 None] Delete group completed successfully. Jul 22 12:14:29 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428 Jul 22 12:14:29 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:29 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a9ed6764-8b4b-4347-a094-caa6dbd0fbf5 tempest-VolumesTestJSON-324111431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428" returned: 0 in 0.476s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a9ed6764-8b4b-4347-a094-caa6dbd0fbf5 tempest-VolumesTestJSON-324111431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:29 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428 Jul 22 12:14:29 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:29 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a9ed6764-8b4b-4347-a094-caa6dbd0fbf5 tempest-VolumesTestJSON-324111431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428" returned: 0 in 0.250s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a9ed6764-8b4b-4347-a094-caa6dbd0fbf5 tempest-VolumesTestJSON-324111431 None] Lock "cinder-quobyte-3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428" released by "delete_volume" :: held 0.776s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:14:29 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-a9ed6764-8b4b-4347-a094-caa6dbd0fbf5 tempest-VolumesTestJSON-324111431 None] Created reservations ['ee524f6f-800d-4f9b-8ce0-d55663ac9716', 'b7de07ec-2984-4b75-88a6-667382f156b2', 'c2ec91bc-46c5-442f-aec6-9b15663655cd', '67df4351-186d-4a70-86f5-e54c337fb8b3'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:14:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a9ed6764-8b4b-4347-a094-caa6dbd0fbf5 tempest-VolumesTestJSON-324111431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a9ed6764-8b4b-4347-a094-caa6dbd0fbf5 tempest-VolumesTestJSON-324111431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a9ed6764-8b4b-4347-a094-caa6dbd0fbf5 tempest-VolumesTestJSON-324111431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a9ed6764-8b4b-4347-a094-caa6dbd0fbf5 tempest-VolumesTestJSON-324111431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a9ed6764-8b4b-4347-a094-caa6dbd0fbf5 tempest-VolumesTestJSON-324111431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a9ed6764-8b4b-4347-a094-caa6dbd0fbf5 tempest-VolumesTestJSON-324111431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:29 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:14:29 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ce316738-ff79-447a-bba3-14a9b178aed8 tempest-VolumesTestJSON-324111431 None] Acquiring lock "cinder-19af195f-41b0-4f63-b561-bc11d874e7f9-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ce316738-ff79-447a-bba3-14a9b178aed8 tempest-VolumesTestJSON-324111431 None] Lock "cinder-19af195f-41b0-4f63-b561-bc11d874e7f9-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ce316738-ff79-447a-bba3-14a9b178aed8 tempest-VolumesTestJSON-324111431 None] Acquiring lock "cinder-quobyte-19af195f-41b0-4f63-b561-bc11d874e7f9" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ce316738-ff79-447a-bba3-14a9b178aed8 tempest-VolumesTestJSON-324111431 None] Lock "cinder-quobyte-19af195f-41b0-4f63-b561-bc11d874e7f9" acquired by "delete_volume" :: waited 0.031s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:30 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaa5e8a-5bd4-41e0-a19d-b84bafe59376]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:14:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ce316738-ff79-447a-bba3-14a9b178aed8 tempest-VolumesTestJSON-324111431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19af195f-41b0-4f63-b561-bc11d874e7f9 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:30 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a9ed6764-8b4b-4347-a094-caa6dbd0fbf5 tempest-VolumesTestJSON-324111431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.529s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:30 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-a9ed6764-8b4b-4347-a094-caa6dbd0fbf5 tempest-VolumesTestJSON-324111431 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:14:30 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-a9ed6764-8b4b-4347-a094-caa6dbd0fbf5 tempest-VolumesTestJSON-324111431 None] Deleted volume successfully. Jul 22 12:14:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a9ed6764-8b4b-4347-a094-caa6dbd0fbf5 tempest-VolumesTestJSON-324111431 None] Lock "cinder-3fee8fb6-54c8-4c1b-ac2a-33b06aaf2428-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:14:30 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19af195f-41b0-4f63-b561-bc11d874e7f9 Jul 22 12:14:30 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:30 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d0d088d3-87bd-4ad9-a2aa-15983f089b10 tempest-GroupsTest-1887415166 None] Group tempest-GroupsTest-Group-553637845: creating Jul 22 12:14:30 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d0d088d3-87bd-4ad9-a2aa-15983f089b10 tempest-GroupsTest-1887415166 None] Group tempest-GroupsTest-Group-553637845: created successfully Jul 22 12:14:30 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d0d088d3-87bd-4ad9-a2aa-15983f089b10 tempest-GroupsTest-1887415166 None] Create group completed successfully. Jul 22 12:14:30 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ce316738-ff79-447a-bba3-14a9b178aed8 tempest-VolumesTestJSON-324111431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19af195f-41b0-4f63-b561-bc11d874e7f9" returned: 0 in 0.467s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ce316738-ff79-447a-bba3-14a9b178aed8 tempest-VolumesTestJSON-324111431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19af195f-41b0-4f63-b561-bc11d874e7f9 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:30 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19af195f-41b0-4f63-b561-bc11d874e7f9 Jul 22 12:14:30 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:31 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ce316738-ff79-447a-bba3-14a9b178aed8 tempest-VolumesTestJSON-324111431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19af195f-41b0-4f63-b561-bc11d874e7f9" returned: 0 in 0.270s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ce316738-ff79-447a-bba3-14a9b178aed8 tempest-VolumesTestJSON-324111431 None] Lock "cinder-quobyte-19af195f-41b0-4f63-b561-bc11d874e7f9" released by "delete_volume" :: held 0.799s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:14:31 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-ce316738-ff79-447a-bba3-14a9b178aed8 tempest-VolumesTestJSON-324111431 None] Created reservations ['6771f23d-96f3-4710-a700-9daab7819cbf', '1cbaeb29-1136-442a-9a35-9a775eec145b', 'a3312cde-5af8-4ba0-9666-e62f60ca08ab', 'c57c5d90-73d8-4eed-a354-6a3ee7e14c3f'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:14:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ce316738-ff79-447a-bba3-14a9b178aed8 tempest-VolumesTestJSON-324111431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ce316738-ff79-447a-bba3-14a9b178aed8 tempest-VolumesTestJSON-324111431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:31 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ce316738-ff79-447a-bba3-14a9b178aed8 tempest-VolumesTestJSON-324111431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:31 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ce316738-ff79-447a-bba3-14a9b178aed8 tempest-VolumesTestJSON-324111431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ce316738-ff79-447a-bba3-14a9b178aed8 tempest-VolumesTestJSON-324111431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ce316738-ff79-447a-bba3-14a9b178aed8 tempest-VolumesTestJSON-324111431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:31 devstack sudo[94967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:14:31 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-65b800fa-13c2-4a33-af52-7c3e2064c494 tempest-VolumesTestJSON-324111431 None] Acquiring lock "cinder-420090ce-860c-446b-b09e-f4990c2487e8-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-65b800fa-13c2-4a33-af52-7c3e2064c494 tempest-VolumesTestJSON-324111431 None] Lock "cinder-420090ce-860c-446b-b09e-f4990c2487e8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-65b800fa-13c2-4a33-af52-7c3e2064c494 tempest-VolumesTestJSON-324111431 None] Acquiring lock "cinder-quobyte-420090ce-860c-446b-b09e-f4990c2487e8" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-65b800fa-13c2-4a33-af52-7c3e2064c494 tempest-VolumesTestJSON-324111431 None] Lock "cinder-quobyte-420090ce-860c-446b-b09e-f4990c2487e8" acquired by "delete_volume" :: waited 0.023s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:31 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c133b1e1-6c1d-491c-94d0-f0ac9f15a0fa]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:14:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-65b800fa-13c2-4a33-af52-7c3e2064c494 tempest-VolumesTestJSON-324111431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-420090ce-860c-446b-b09e-f4990c2487e8 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:31 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ce316738-ff79-447a-bba3-14a9b178aed8 tempest-VolumesTestJSON-324111431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.284s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:31 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-ce316738-ff79-447a-bba3-14a9b178aed8 tempest-VolumesTestJSON-324111431 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:14:31 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-ce316738-ff79-447a-bba3-14a9b178aed8 tempest-VolumesTestJSON-324111431 None] Deleted volume successfully. Jul 22 12:14:31 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-420090ce-860c-446b-b09e-f4990c2487e8 Jul 22 12:14:31 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ce316738-ff79-447a-bba3-14a9b178aed8 tempest-VolumesTestJSON-324111431 None] Lock "cinder-19af195f-41b0-4f63-b561-bc11d874e7f9-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:14:31 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-65b800fa-13c2-4a33-af52-7c3e2064c494 tempest-VolumesTestJSON-324111431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-420090ce-860c-446b-b09e-f4990c2487e8" returned: 0 in 0.375s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-65b800fa-13c2-4a33-af52-7c3e2064c494 tempest-VolumesTestJSON-324111431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-420090ce-860c-446b-b09e-f4990c2487e8 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:31 devstack sudo[94975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-420090ce-860c-446b-b09e-f4990c2487e8 Jul 22 12:14:31 devstack sudo[94975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:32 devstack sudo[94975]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-65b800fa-13c2-4a33-af52-7c3e2064c494 tempest-VolumesTestJSON-324111431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-420090ce-860c-446b-b09e-f4990c2487e8" returned: 0 in 0.300s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-65b800fa-13c2-4a33-af52-7c3e2064c494 tempest-VolumesTestJSON-324111431 None] Lock "cinder-quobyte-420090ce-860c-446b-b09e-f4990c2487e8" released by "delete_volume" :: held 0.723s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-65b800fa-13c2-4a33-af52-7c3e2064c494 tempest-VolumesTestJSON-324111431 None] Created reservations ['9e9ed913-07ad-40ce-bddc-82b0562afcfd', '5a75de9b-4990-49b4-8812-f9b3949ed9fc', 'd56f28ab-42cb-4519-b2d9-1fc868ce365c', '18578c61-4c46-4ab0-a768-a3e39bed10f9'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-65b800fa-13c2-4a33-af52-7c3e2064c494 tempest-VolumesTestJSON-324111431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-65b800fa-13c2-4a33-af52-7c3e2064c494 tempest-VolumesTestJSON-324111431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-65b800fa-13c2-4a33-af52-7c3e2064c494 tempest-VolumesTestJSON-324111431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-65b800fa-13c2-4a33-af52-7c3e2064c494 tempest-VolumesTestJSON-324111431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-65b800fa-13c2-4a33-af52-7c3e2064c494 tempest-VolumesTestJSON-324111431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-65b800fa-13c2-4a33-af52-7c3e2064c494 tempest-VolumesTestJSON-324111431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:14:32 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:14:32 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Flow 'volume_create_manager' (5bd9955b-eb13-4388-8899-2794bc26bf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd53cbe-fd44-447a-8cd7-d3e392668b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd53cbe-fd44-447a-8cd7-d3e392668b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-473163238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e7a75d7-c8e1-4338-bbc0-fc7c2596b40f,host='devstack@QuobyteHD#QuobyteHD',id=682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7e7e810c904ced8fa0f8b85457cd74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:14:32Z,use_quota=True,user_id='ba17b6658cea41a6a67a9bd7ab1f84ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8b2063e-0cca-4921-b4be-e41f06380257),volume_type_id=c8b2063e-0cca-4921-b4be-e41f06380257)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd1f051-e272-425f-a37a-f27214759480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd1f051-e272-425f-a37a-f27214759480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f282cb-2ae1-4876-a2ca-35f8a87ecfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f282cb-2ae1-4876-a2ca-35f8a87ecfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0', 'volume_name': 'volume-682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78314ed2-5954-440e-9bd4-75679dc9348e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78314ed2-5954-440e-9bd4-75679dc9348e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be7e20f-8a0a-44a4-bf4b-fcdc9f9d6021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:32 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Volume 682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0', 'volume_size': 1} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1e7a75d7-c8e1-4338-bbc0-fc7c2596b40f,created_at=2026-07-22T10:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-473163238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e7a75d7-c8e1-4338-bbc0-fc7c2596b40f,host='devstack@QuobyteHD#QuobyteHD',id=682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7e7e810c904ced8fa0f8b85457cd74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:14:32Z,use_quota=True,user_id='ba17b6658cea41a6a67a9bd7ab1f84ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8b2063e-0cca-4921-b4be-e41f06380257),volume_type_id=c8b2063e-0cca-4921-b4be-e41f06380257)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Creating volume 682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:14:32 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:32 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0 1073741824 Jul 22 12:14:32 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:32 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-65b800fa-13c2-4a33-af52-7c3e2064c494 tempest-VolumesTestJSON-324111431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.347s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-65b800fa-13c2-4a33-af52-7c3e2064c494 tempest-VolumesTestJSON-324111431 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:14:32 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-65b800fa-13c2-4a33-af52-7c3e2064c494 tempest-VolumesTestJSON-324111431 None] Deleted volume successfully. Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-65b800fa-13c2-4a33-af52-7c3e2064c494 tempest-VolumesTestJSON-324111431 None] Lock "cinder-420090ce-860c-446b-b09e-f4990c2487e8-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:14:32 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0 1073741824" returned: 0 in 0.550s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:33 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0 Jul 22 12:14:33 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:33 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0" returned: 0 in 0.277s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:14:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be7e20f-8a0a-44a4-bf4b-fcdc9f9d6021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd109baa-615d-47a2-a732-6730c77418b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:33 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Volume volume-682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0 (682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0): created successfully Jul 22 12:14:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd109baa-615d-47a2-a732-6730c77418b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Flow 'volume_create_manager' (5bd9955b-eb13-4388-8899-2794bc26bf48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:14:33 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-1a22d4b6-8d0c-4f1a-af4b-1c5ea1dd1145 tempest-GroupsTest-1887415166 None] Created volume successfully. Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Flow 'volume_create_manager' (66456aee-fa4f-45d1-910c-a938ec47fbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba9f979-4c34-49e7-86e8-59862cb312bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1eb6b1ac-6867-4b29-8d43-ab41020c7cff tempest-BackendsCapabilitiesAdminTestsJSON-222505196 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6803550720215, 'free_capacity_gb': 1775.6803550720215, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87568) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba9f979-4c34-49e7-86e8-59862cb312bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-401270039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e7a75d7-c8e1-4338-bbc0-fc7c2596b40f,host='devstack@QuobyteHD#QuobyteHD',id=f262042c-7523-458f-b2b9-653bd5ad1837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7e7e810c904ced8fa0f8b85457cd74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:14:34Z,use_quota=True,user_id='ba17b6658cea41a6a67a9bd7ab1f84ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8b2063e-0cca-4921-b4be-e41f06380257),volume_type_id=c8b2063e-0cca-4921-b4be-e41f06380257)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc214ba-add4-4e65-a859-628016b4c249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc214ba-add4-4e65-a859-628016b4c249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4cc740-43d9-412d-b918-129e35dddb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4cc740-43d9-412d-b918-129e35dddb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f262042c-7523-458f-b2b9-653bd5ad1837', 'volume_name': 'volume-f262042c-7523-458f-b2b9-653bd5ad1837', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259145a6-a8c1-47b3-9496-6feef1560592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259145a6-a8c1-47b3-9496-6feef1560592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f2458e-277d-4034-ba0d-90042184f01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:34 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Volume f262042c-7523-458f-b2b9-653bd5ad1837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f262042c-7523-458f-b2b9-653bd5ad1837', 'volume_size': 1} Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1e7a75d7-c8e1-4338-bbc0-fc7c2596b40f,created_at=2026-07-22T10:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-401270039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e7a75d7-c8e1-4338-bbc0-fc7c2596b40f,host='devstack@QuobyteHD#QuobyteHD',id=f262042c-7523-458f-b2b9-653bd5ad1837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7e7e810c904ced8fa0f8b85457cd74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:14:34Z,use_quota=True,user_id='ba17b6658cea41a6a67a9bd7ab1f84ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8b2063e-0cca-4921-b4be-e41f06380257),volume_type_id=c8b2063e-0cca-4921-b4be-e41f06380257)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Creating volume f262042c-7523-458f-b2b9-653bd5ad1837 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:14:34 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f262042c-7523-458f-b2b9-653bd5ad1837 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f9df53e1-3ca3-4b25-9637-3a6835bc6938 tempest-BackendsCapabilitiesAdminTestsJSON-222505196 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6803550720215, 'free_capacity_gb': 1775.6803550720215, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87568) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 22 12:14:34 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f262042c-7523-458f-b2b9-653bd5ad1837 1073741824 Jul 22 12:14:34 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:35 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f262042c-7523-458f-b2b9-653bd5ad1837 1073741824" returned: 0 in 0.576s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f262042c-7523-458f-b2b9-653bd5ad1837 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:35 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f262042c-7523-458f-b2b9-653bd5ad1837 Jul 22 12:14:35 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:35 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f262042c-7523-458f-b2b9-653bd5ad1837" returned: 0 in 0.325s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:14:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f2458e-277d-4034-ba0d-90042184f01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f262042c-7523-458f-b2b9-653bd5ad1837', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40cb7ad-87ac-43a6-ba4e-b2959fa94108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:35 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Volume volume-f262042c-7523-458f-b2b9-653bd5ad1837 (f262042c-7523-458f-b2b9-653bd5ad1837): created successfully Jul 22 12:14:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40cb7ad-87ac-43a6-ba4e-b2959fa94108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Flow 'volume_create_manager' (66456aee-fa4f-45d1-910c-a938ec47fbb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:14:35 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-5013deeb-d77e-483a-9c59-f540b5a76815 tempest-GroupsTest-1887415166 None] Created volume successfully. Jul 22 12:14:36 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-28dbd013-883f-48ba-9c77-b111b78e96b2 tempest-GroupsTest-1887415166 None] Update group completed successfully. Jul 22 12:14:38 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-2a4af785-094a-4b80-836c-08d06519e3ed tempest-GroupsTest-1887415166 None] Update group completed successfully. Jul 22 12:14:39 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:14:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Flow 'volume_create_manager' (1a73875b-f252-44ce-a8cd-67129fe652a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:14:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684a294c-bb91-4598-b2c0-e385f2d66e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684a294c-bb91-4598-b2c0-e385f2d66e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1116803672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016cc1ac17814b93bedc23fcf92d8a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:14:39Z,use_quota=True,user_id='fcef4427fa544f2480f12df2f496e096',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb083d51-e381-48a5-a507-49c07850522c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb083d51-e381-48a5-a507-49c07850522c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c4de3f-cb82-49ab-afbb-1c790e91988e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c4de3f-cb82-49ab-afbb-1c790e91988e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe', 'volume_name': 'volume-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215a87f7-c3a7-49c0-849f-02794d9a93ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215a87f7-c3a7-49c0-849f-02794d9a93ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebce3c0b-1313-4f0f-9245-dc072c66200b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:39 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Volume b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe', 'volume_size': 1} Jul 22 12:14:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1116803672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016cc1ac17814b93bedc23fcf92d8a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:14:39Z,use_quota=True,user_id='fcef4427fa544f2480f12df2f496e096',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:14:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Creating volume b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:14:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:14:39 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:14:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:39 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe 1073741824 Jul 22 12:14:39 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Acquiring lock "cinder-quobyte-682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe 1073741824" returned: 0 in 0.625s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:40 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Lock "cinder-quobyte-682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0" acquired by "delete_volume" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:40 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d63910-0059-41bd-bdd6-72c46bfb8f0e]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:14:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:40 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe Jul 22 12:14:40 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:40 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0 Jul 22 12:14:40 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:40 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe" returned: 0 in 0.352s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:14:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebce3c0b-1313-4f0f-9245-dc072c66200b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ebff53-aff2-4dac-a1d6-7839c55fed55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:40 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Volume volume-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe (b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe): created successfully Jul 22 12:14:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ebff53-aff2-4dac-a1d6-7839c55fed55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Flow 'volume_create_manager' (1a73875b-f252-44ce-a8cd-67129fe652a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:14:40 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b9ad2e39-444f-4ed4-abdc-be919877b982 tempest-AttachVolumeNegativeTest-1159479948 None] Created volume successfully. Jul 22 12:14:40 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0" returned: 0 in 0.516s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:40 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0 Jul 22 12:14:40 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:41 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0" returned: 0 in 0.291s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Lock "cinder-quobyte-682c5e71-8320-49a0-8f4b-c4e6a6b6d4b0" released by "delete_volume" :: held 0.873s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:14:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Acquiring lock "cinder-quobyte-f262042c-7523-458f-b2b9-653bd5ad1837" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Lock "cinder-quobyte-f262042c-7523-458f-b2b9-653bd5ad1837" acquired by "delete_volume" :: waited 0.014s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:41 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1666c2-dea5-4203-9aa5-b3070e6f5657]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:14:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f262042c-7523-458f-b2b9-653bd5ad1837 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:41 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f262042c-7523-458f-b2b9-653bd5ad1837 Jul 22 12:14:41 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:41 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f262042c-7523-458f-b2b9-653bd5ad1837" returned: 0 in 0.513s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f262042c-7523-458f-b2b9-653bd5ad1837 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:41 devstack sudo[95043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f262042c-7523-458f-b2b9-653bd5ad1837 Jul 22 12:14:41 devstack sudo[95043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:42 devstack sudo[95043]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f262042c-7523-458f-b2b9-653bd5ad1837" returned: 0 in 0.326s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:42 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Lock "cinder-quobyte-f262042c-7523-458f-b2b9-653bd5ad1837" released by "delete_volume" :: held 0.895s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:14:42 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Created reservations ['f77f515c-833e-4e73-a2dc-6982b67e06c6'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:14:42 devstack cinder-volume[87568]: WARNING cinder.quota [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1517996062 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1517996062, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:14:42 devstack cinder-volume[87568]: WARNING cinder.quota [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1517996062 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1517996062, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:14:42 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Created reservations ['27aa96c3-4827-41e5-9241-6818ebda46c0', 'd0d74392-e7cc-415b-8212-76ecd09d530f', 'c76d0c2d-c725-4f16-9bbf-ae2cd55ae577', '1507ec32-1546-4569-94e2-04cad0c9149b'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:14:42 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Created reservations ['89ae874d-2140-4c38-a9af-6964db9185c8', 'fcc709fb-48af-4605-a37d-f7c9f216d6ea', 'e16b1ba2-8501-43f3-92a5-4ec1f185f979', 'f8207281-b17d-45dd-b5e1-a6a95bd03d3d'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:14:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-c8feb275-c0e3-4b80-997a-9bf30e8fe340 req-6e642f6d-aa3f-4dca-8cdc-af41753b0e52 tempest-AttachVolumeNegativeTest-1159479948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-c8feb275-c0e3-4b80-997a-9bf30e8fe340 req-6e642f6d-aa3f-4dca-8cdc-af41753b0e52 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:42 devstack sudo[95054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:14:42 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-c8feb275-c0e3-4b80-997a-9bf30e8fe340 req-6e642f6d-aa3f-4dca-8cdc-af41753b0e52 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-c8feb275-c0e3-4b80-997a-9bf30e8fe340 req-6e642f6d-aa3f-4dca-8cdc-af41753b0e52 tempest-AttachVolumeNegativeTest-1159479948 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29', 'name': 'volume-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64ccc16a-3a55-410e-980b-074fabe368d5', 'enforce_multipath': True} {{(pid=87568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 12:14:42 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-c8feb275-c0e3-4b80-997a-9bf30e8fe340 req-6e642f6d-aa3f-4dca-8cdc-af41753b0e52 tempest-AttachVolumeNegativeTest-1159479948 None] attachment_update completed successfully. Jul 22 12:14:43 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.420s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:43 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:14:43 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-4de44398-55c5-4221-b548-8a0a2371f893 tempest-GroupsTest-1887415166 None] Delete group completed successfully. Jul 22 12:14:44 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-3563e2fe-d031-4f5e-bf39-69cd8785016c tempest-GroupsV314Test-543926491 None] Group tempest-GroupsV314Test-Group-839654475: creating Jul 22 12:14:44 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-3563e2fe-d031-4f5e-bf39-69cd8785016c tempest-GroupsV314Test-543926491 None] Group tempest-GroupsV314Test-Group-839654475: created successfully Jul 22 12:14:44 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-3563e2fe-d031-4f5e-bf39-69cd8785016c tempest-GroupsV314Test-543926491 None] Create group completed successfully. Jul 22 12:14:45 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-97a68231-4e45-4d92-aa3c-d0033b9e8e58 req-3a7a061b-fa99-4a8a-bd4b-b4703a2971f2 tempest-AttachVolumeNegativeTest-1159479948 None] Terminate volume connection completed successfully. Jul 22 12:14:45 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-97a68231-4e45-4d92-aa3c-d0033b9e8e58 req-3a7a061b-fa99-4a8a-bd4b-b4703a2971f2 tempest-AttachVolumeNegativeTest-1159479948 None] Deleting attachment 64ccc16a-3a55-410e-980b-074fabe368d5. {{(pid=87568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 12:14:46 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:14:46 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Flow 'volume_create_manager' (e546ea8c-e82c-4e99-9d32-6b19e0502ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:14:46 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3293c4-f2a3-4710-bbbd-b748dd406444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3293c4-f2a3-4710-bbbd-b748dd406444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1353967230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=10fe12a2-c690-4436-a854-dd713d8764a6,host='devstack@QuobyteHD#QuobyteHD',id=98018077-7390-4348-8a61-dd54d93833b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f23532379df7491bb7f920263cdfc5b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:14:47Z,use_quota=True,user_id='32a9fa1e83364c6eb60aceec39667acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0875df89-60b4-4285-ba66-0db022766c44),volume_type_id=0875df89-60b4-4285-ba66-0db022766c44)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dee4113-ba1b-4738-8249-302e81e5e653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dee4113-ba1b-4738-8249-302e81e5e653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c64ba8-f495-4f8f-897f-7a9c82897d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c64ba8-f495-4f8f-897f-7a9c82897d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98018077-7390-4348-8a61-dd54d93833b5', 'volume_name': 'volume-98018077-7390-4348-8a61-dd54d93833b5', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c0144d9-ebe8-4e23-ae6b-7e71dbc1f62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c0144d9-ebe8-4e23-ae6b-7e71dbc1f62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b2bc42-c98b-45a5-9893-a07efaef7912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:47 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Volume 98018077-7390-4348-8a61-dd54d93833b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98018077-7390-4348-8a61-dd54d93833b5', 'volume_size': 1} Jul 22 12:14:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:47 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=10fe12a2-c690-4436-a854-dd713d8764a6,created_at=2026-07-22T10:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1353967230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=10fe12a2-c690-4436-a854-dd713d8764a6,host='devstack@QuobyteHD#QuobyteHD',id=98018077-7390-4348-8a61-dd54d93833b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f23532379df7491bb7f920263cdfc5b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:14:47Z,use_quota=True,user_id='32a9fa1e83364c6eb60aceec39667acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0875df89-60b4-4285-ba66-0db022766c44),volume_type_id=0875df89-60b4-4285-ba66-0db022766c44)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:14:47 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Creating volume 98018077-7390-4348-8a61-dd54d93833b5 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:14:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:47 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:47 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:47 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:14:47 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:14:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:47 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5 1073741824 Jul 22 12:14:47 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:47 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5 1073741824" returned: 0 in 0.614s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:47 devstack sudo[95491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5 Jul 22 12:14:47 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:48 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5" returned: 0 in 0.356s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:14:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b2bc42-c98b-45a5-9893-a07efaef7912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98018077-7390-4348-8a61-dd54d93833b5', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6441ee-4198-4676-a44e-290fdb61b050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:48 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Volume volume-98018077-7390-4348-8a61-dd54d93833b5 (98018077-7390-4348-8a61-dd54d93833b5): created successfully Jul 22 12:14:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6441ee-4198-4676-a44e-290fdb61b050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Flow 'volume_create_manager' (e546ea8c-e82c-4e99-9d32-6b19e0502ee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:14:48 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d97df919-dbd0-4150-a433-901c33e0dad4 tempest-GroupsV314Test-543926491 None] Created volume successfully. Jul 22 12:14:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:50 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Cloning volume 98018077-7390-4348-8a61-dd54d93833b5 to volume 2a8c80b4-3637-4b9f-bce1-114f95d34cfb Jul 22 12:14:50 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Creating offline snapshot 7b2b270b-963c-4768-b136-d39e16c7deab of volume 98018077-7390-4348-8a61-dd54d93833b5 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:14:50 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d05dd3-b801-4260-8b55-44448cceb944]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:14:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:50 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5 Jul 22 12:14:50 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:50 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5" returned: 0 in 0.517s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:50 devstack sudo[95504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab 1G Jul 22 12:14:50 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:51 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ef2c2400-fa01-45e6-8199-3770638d5162 tempest-AttachVolumeNegativeTest-1159479948 None] Acquiring lock "cinder-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:51 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ef2c2400-fa01-45e6-8199-3770638d5162 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "cinder-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:51 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab 1G" returned: 0 in 0.620s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98018077-7390-4348-8a61-dd54d93833b5 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:51 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:14:51 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98018077-7390-4348-8a61-dd54d93833b5 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab Jul 22 12:14:51 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Flow 'volume_create_manager' (60d3630c-ed52-4bc7-bddb-b5fa38945b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:14:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e7dc0a-410e-49dd-9137-49b5b796ec58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:51 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ef2c2400-fa01-45e6-8199-3770638d5162 tempest-AttachVolumeNegativeTest-1159479948 None] Acquiring lock "cinder-quobyte-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e7dc0a-410e-49dd-9137-49b5b796ec58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1384249972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75559ea4-eff1-4abb-9aa6-d17510c9d891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b245a6718341d48ec21569f1658d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:14:51Z,use_quota=True,user_id='efd9bc7381fa48009d35177da12861ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2548c595-f751-4e90-9663-7f7544fb70a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2548c595-f751-4e90-9663-7f7544fb70a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6439e27c-4c3f-4765-81fb-83fa7a6bfd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6439e27c-4c3f-4765-81fb-83fa7a6bfd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75559ea4-eff1-4abb-9aa6-d17510c9d891', 'volume_name': 'volume-75559ea4-eff1-4abb-9aa6-d17510c9d891', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (078f26fe-3125-4154-b69c-fb4d01704001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (078f26fe-3125-4154-b69c-fb4d01704001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d1df06-f0d7-4a03-aa02-100d5b835149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:51 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Volume 75559ea4-eff1-4abb-9aa6-d17510c9d891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75559ea4-eff1-4abb-9aa6-d17510c9d891', 'volume_size': 1} Jul 22 12:14:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:51 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ef2c2400-fa01-45e6-8199-3770638d5162 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "cinder-quobyte-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe" acquired by "delete_volume" :: waited 0.072s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:51 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[576c939d-3406-4746-83d8-67ff5d023f92]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:14:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ef2c2400-fa01-45e6-8199-3770638d5162 tempest-AttachVolumeNegativeTest-1159479948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:51 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe Jul 22 12:14:51 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:51 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98018077-7390-4348-8a61-dd54d93833b5 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab" returned: 0 in 0.389s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:51 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab is being set with open permissions: ugo+rw: NotImplementedError Jul 22 12:14:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:51 devstack sudo[95517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab Jul 22 12:14:51 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:52 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ef2c2400-fa01-45e6-8199-3770638d5162 tempest-AttachVolumeNegativeTest-1159479948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe" returned: 0 in 0.423s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ef2c2400-fa01-45e6-8199-3770638d5162 tempest-AttachVolumeNegativeTest-1159479948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:52 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe Jul 22 12:14:52 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:52 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab" returned: 0 in 0.316s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:52 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.info Jul 22 12:14:52 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:52 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ef2c2400-fa01-45e6-8199-3770638d5162 tempest-AttachVolumeNegativeTest-1159479948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe" returned: 0 in 0.316s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ef2c2400-fa01-45e6-8199-3770638d5162 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "cinder-quobyte-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe" released by "delete_volume" :: held 0.806s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-ef2c2400-fa01-45e6-8199-3770638d5162 tempest-AttachVolumeNegativeTest-1159479948 None] Created reservations ['661242ca-d0fa-4528-b1f1-20936294e6a6', '9d0574e8-0bc2-4c6e-8788-d53504f16f59', '5ab6d913-5c63-4a50-8871-648ba6706451', '5b26d5e6-9b25-4d8b-97fe-964bca915fde'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ef2c2400-fa01-45e6-8199-3770638d5162 tempest-AttachVolumeNegativeTest-1159479948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ef2c2400-fa01-45e6-8199-3770638d5162 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ef2c2400-fa01-45e6-8199-3770638d5162 tempest-AttachVolumeNegativeTest-1159479948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ef2c2400-fa01-45e6-8199-3770638d5162 tempest-AttachVolumeNegativeTest-1159479948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ef2c2400-fa01-45e6-8199-3770638d5162 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ef2c2400-fa01-45e6-8199-3770638d5162 tempest-AttachVolumeNegativeTest-1159479948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:52 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.info" returned: 0 in 0.350s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:52 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:52 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:14:52 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:52 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.info Jul 22 12:14:52 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-62351c73-1b4f-484d-89e7-bf3bc7007d45 tempest-AttachVolumeNegativeTest-1159479948 None] Acquiring lock "cinder-f799a766-4082-4c4d-9b4d-99d88db15b89-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-62351c73-1b4f-484d-89e7-bf3bc7007d45 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "cinder-f799a766-4082-4c4d-9b4d-99d88db15b89-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-62351c73-1b4f-484d-89e7-bf3bc7007d45 tempest-AttachVolumeNegativeTest-1159479948 None] Acquiring lock "cinder-quobyte-f799a766-4082-4c4d-9b4d-99d88db15b89" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-62351c73-1b4f-484d-89e7-bf3bc7007d45 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "cinder-quobyte-f799a766-4082-4c4d-9b4d-99d88db15b89" acquired by "delete_volume" :: waited 0.016s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:52 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.info" returned: 0 in 0.299s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Acquiring lock "cinder-quobyte-2a8c80b4-3637-4b9f-bce1-114f95d34cfb" by "_copy_volume_from_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce41bd6-614f-4c02-a1ca-20d5aff0fd3f]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-62351c73-1b4f-484d-89e7-bf3bc7007d45 tempest-AttachVolumeNegativeTest-1159479948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f799a766-4082-4c4d-9b4d-99d88db15b89 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:52 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ef2c2400-fa01-45e6-8199-3770638d5162 tempest-AttachVolumeNegativeTest-1159479948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.361s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-ef2c2400-fa01-45e6-8199-3770638d5162 tempest-AttachVolumeNegativeTest-1159479948 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:14:52 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-ef2c2400-fa01-45e6-8199-3770638d5162 tempest-AttachVolumeNegativeTest-1159479948 None] Deleted volume successfully. Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Lock "cinder-quobyte-2a8c80b4-3637-4b9f-bce1-114f95d34cfb" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] snapshot: 7b2b270b-963c-4768-b136-d39e16c7deab, volume: 2a8c80b4-3637-4b9f-bce1-114f95d34cfb, {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ef2c2400-fa01-45e6-8199-3770638d5162 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "cinder-b1cce228-93a7-44e4-b5a5-6c70e4ec4ebe-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d809f312-102e-445b-aa08-b61936035f02]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:53 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f799a766-4082-4c4d-9b4d-99d88db15b89 Jul 22 12:14:53 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:53 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab Jul 22 12:14:53 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:53 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-62351c73-1b4f-484d-89e7-bf3bc7007d45 tempest-AttachVolumeNegativeTest-1159479948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f799a766-4082-4c4d-9b4d-99d88db15b89" returned: 0 in 0.427s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-62351c73-1b4f-484d-89e7-bf3bc7007d45 tempest-AttachVolumeNegativeTest-1159479948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f799a766-4082-4c4d-9b4d-99d88db15b89 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:53 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f799a766-4082-4c4d-9b4d-99d88db15b89 Jul 22 12:14:53 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:53 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab" returned: 0 in 0.445s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98018077-7390-4348-8a61-dd54d93833b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] will copy from snapshot at /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5 {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Creating direct copy from snapshot {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[89724cf1-0bdf-4ec9-9b50-e450a4e18bf2]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:53 devstack sudo[95547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5 Jul 22 12:14:53 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:53 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-62351c73-1b4f-484d-89e7-bf3bc7007d45 tempest-AttachVolumeNegativeTest-1159479948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f799a766-4082-4c4d-9b4d-99d88db15b89" returned: 0 in 0.294s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-62351c73-1b4f-484d-89e7-bf3bc7007d45 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "cinder-quobyte-f799a766-4082-4c4d-9b4d-99d88db15b89" released by "delete_volume" :: held 0.779s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-62351c73-1b4f-484d-89e7-bf3bc7007d45 tempest-AttachVolumeNegativeTest-1159479948 None] Created reservations ['5e496d97-63c0-401c-ac9f-7b0fd8f61c7c', '488ce23f-38b7-408f-bf94-531cfc90363c', '245a9931-7130-4b09-b3e2-2c6a3964618e', '9c2f0fc7-4f3a-4bbe-ad4b-595bae93fad0'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-62351c73-1b4f-484d-89e7-bf3bc7007d45 tempest-AttachVolumeNegativeTest-1159479948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-62351c73-1b4f-484d-89e7-bf3bc7007d45 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-62351c73-1b4f-484d-89e7-bf3bc7007d45 tempest-AttachVolumeNegativeTest-1159479948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-62351c73-1b4f-484d-89e7-bf3bc7007d45 tempest-AttachVolumeNegativeTest-1159479948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-62351c73-1b4f-484d-89e7-bf3bc7007d45 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-62351c73-1b4f-484d-89e7-bf3bc7007d45 tempest-AttachVolumeNegativeTest-1159479948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:53 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:14:53 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:53 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5" returned: 0 in 0.419s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG cinder.utils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Path /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2a8c80b4-3637-4b9f-bce1-114f95d34cfb not found in is_blk_device check {{(pid=87568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 12:14:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2a8c80b4-3637-4b9f-bce1-114f95d34cfb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:53 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2a8c80b4-3637-4b9f-bce1-114f95d34cfb Jul 22 12:14:53 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:54 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-62351c73-1b4f-484d-89e7-bf3bc7007d45 tempest-AttachVolumeNegativeTest-1159479948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.319s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:54 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-62351c73-1b4f-484d-89e7-bf3bc7007d45 tempest-AttachVolumeNegativeTest-1159479948 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:14:54 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-62351c73-1b4f-484d-89e7-bf3bc7007d45 tempest-AttachVolumeNegativeTest-1159479948 None] Deleted volume successfully. Jul 22 12:14:54 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-62351c73-1b4f-484d-89e7-bf3bc7007d45 tempest-AttachVolumeNegativeTest-1159479948 None] Lock "cinder-f799a766-4082-4c4d-9b4d-99d88db15b89-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:14:54 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20a5b0d5-940f-4127-b054-c4624810e3cf tempest-AttachVolumeNegativeTest-1159479948 None] Acquiring lock "cinder-4b200f46-8c3b-4926-9f90-334f05d1cc5c-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:54 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20a5b0d5-940f-4127-b054-c4624810e3cf tempest-AttachVolumeNegativeTest-1159479948 None] Lock "cinder-4b200f46-8c3b-4926-9f90-334f05d1cc5c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:54 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20a5b0d5-940f-4127-b054-c4624810e3cf tempest-AttachVolumeNegativeTest-1159479948 None] Acquiring lock "cinder-quobyte-4b200f46-8c3b-4926-9f90-334f05d1cc5c" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:14:54 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20a5b0d5-940f-4127-b054-c4624810e3cf tempest-AttachVolumeNegativeTest-1159479948 None] Lock "cinder-quobyte-4b200f46-8c3b-4926-9f90-334f05d1cc5c" acquired by "delete_volume" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:14:54 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[54836e03-c407-4027-b91b-e4a0274d89cc]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:14:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20a5b0d5-940f-4127-b054-c4624810e3cf tempest-AttachVolumeNegativeTest-1159479948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b200f46-8c3b-4926-9f90-334f05d1cc5c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:54 devstack sudo[95562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b200f46-8c3b-4926-9f90-334f05d1cc5c Jul 22 12:14:54 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:55 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20a5b0d5-940f-4127-b054-c4624810e3cf tempest-AttachVolumeNegativeTest-1159479948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b200f46-8c3b-4926-9f90-334f05d1cc5c" returned: 0 in 0.723s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20a5b0d5-940f-4127-b054-c4624810e3cf tempest-AttachVolumeNegativeTest-1159479948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b200f46-8c3b-4926-9f90-334f05d1cc5c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:55 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b200f46-8c3b-4926-9f90-334f05d1cc5c Jul 22 12:14:55 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:55 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20a5b0d5-940f-4127-b054-c4624810e3cf tempest-AttachVolumeNegativeTest-1159479948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b200f46-8c3b-4926-9f90-334f05d1cc5c" returned: 0 in 0.808s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20a5b0d5-940f-4127-b054-c4624810e3cf tempest-AttachVolumeNegativeTest-1159479948 None] Lock "cinder-quobyte-4b200f46-8c3b-4926-9f90-334f05d1cc5c" released by "delete_volume" :: held 1.599s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:14:56 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-20a5b0d5-940f-4127-b054-c4624810e3cf tempest-AttachVolumeNegativeTest-1159479948 None] Created reservations ['a883c8ac-97ad-447b-983e-d11cec1c6e62', '78552d95-9d78-4e99-902f-e875533ee24a', 'fdae1717-d360-40d2-a928-06256ef3ebe6', 'd8e15e65-d3a9-44be-a9dc-b50e5c26ba5e'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:14:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-20a5b0d5-940f-4127-b054-c4624810e3cf tempest-AttachVolumeNegativeTest-1159479948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-20a5b0d5-940f-4127-b054-c4624810e3cf tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:14:56 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-20a5b0d5-940f-4127-b054-c4624810e3cf tempest-AttachVolumeNegativeTest-1159479948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:14:56 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-20a5b0d5-940f-4127-b054-c4624810e3cf tempest-AttachVolumeNegativeTest-1159479948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:14:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-20a5b0d5-940f-4127-b054-c4624810e3cf tempest-AttachVolumeNegativeTest-1159479948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:14:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20a5b0d5-940f-4127-b054-c4624810e3cf tempest-AttachVolumeNegativeTest-1159479948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:56 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:14:56 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:56 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20a5b0d5-940f-4127-b054-c4624810e3cf tempest-AttachVolumeNegativeTest-1159479948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.410s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:56 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-20a5b0d5-940f-4127-b054-c4624810e3cf tempest-AttachVolumeNegativeTest-1159479948 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:14:56 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-20a5b0d5-940f-4127-b054-c4624810e3cf tempest-AttachVolumeNegativeTest-1159479948 None] Deleted volume successfully. Jul 22 12:14:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20a5b0d5-940f-4127-b054-c4624810e3cf tempest-AttachVolumeNegativeTest-1159479948 None] Lock "cinder-4b200f46-8c3b-4926-9f90-334f05d1cc5c-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:14:57 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:14:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Flow 'volume_create_manager' (bb270692-4e9c-4270-b0e4-e16850562d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:14:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8845b57a-719e-43da-88a9-f900193a1e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8845b57a-719e-43da-88a9-f900193a1e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-107292448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f799a2-0a56-42a4-bcca-83df999e1581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58917ad1b6154de9a849d1a561d61131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:14:58Z,use_quota=True,user_id='04e295e5c09b45829ea3fbfd2feea9bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72063b93-fc72-4e28-aedd-8a550e619363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72063b93-fc72-4e28-aedd-8a550e619363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd54440-8302-4d9b-b70d-cf75cbade4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd54440-8302-4d9b-b70d-cf75cbade4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64f799a2-0a56-42a4-bcca-83df999e1581', 'volume_name': 'volume-64f799a2-0a56-42a4-bcca-83df999e1581', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de04b5a0-7e2a-4a4a-8ea9-bed52f6d779e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de04b5a0-7e2a-4a4a-8ea9-bed52f6d779e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:14:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0dda11-64cf-4e3f-a5b1-8c476b89ab47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:14:58 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Volume 64f799a2-0a56-42a4-bcca-83df999e1581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64f799a2-0a56-42a4-bcca-83df999e1581', 'volume_size': 1} Jul 22 12:14:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:14:59 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2a8c80b4-3637-4b9f-bce1-114f95d34cfb" returned: 0 in 5.458s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:59 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d511e2-06b3-4e37-92c0-de44ac18bf77]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:14:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:14:59 devstack sudo[95581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5 Jul 22 12:14:59 devstack sudo[95581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:14:59 devstack sudo[95581]: pam_unix(sudo:session): session closed for user root Jul 22 12:14:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5" returned: 0 in 0.589s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:14:59 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Image conversion details: src /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5, size 1024.00 MB, duration 5.46 sec, destination /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2a8c80b4-3637-4b9f-bce1-114f95d34cfb {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:14:59 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Converted 1024.00 MB image at 187.58 MB/s Jul 22 12:14:59 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2a8c80b4-3637-4b9f-bce1-114f95d34cfb is being set with open permissions: ugo+rw: NotImplementedError Jul 22 12:14:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2a8c80b4-3637-4b9f-bce1-114f95d34cfb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:00 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2a8c80b4-3637-4b9f-bce1-114f95d34cfb Jul 22 12:15:00 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:00 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2a8c80b4-3637-4b9f-bce1-114f95d34cfb" returned: 0 in 0.240s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Lock "cinder-quobyte-2a8c80b4-3637-4b9f-bce1-114f95d34cfb" released by "_copy_volume_from_snapshot" :: held 7.274s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:00 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:UPDATE=151,cinder:INSERT=38,cinder:DELETE=7,cinder:SELECT=140 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:15:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Acquiring lock "cinder-quobyte-7b2b270b-963c-4768-b136-d39e16c7deab" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Lock "cinder-quobyte-7b2b270b-963c-4768-b136-d39e16c7deab" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Deleting offline snapshot 7b2b270b-963c-4768-b136-d39e16c7deab of volume 98018077-7390-4348-8a61-dd54d93833b5 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:15:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] snapshot_file for this snap is: volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:15:00 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd052f03-592a-4588-b4a3-69c025205de0]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:00 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab Jul 22 12:15:00 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:00 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab" returned: 0 in 0.386s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98018077-7390-4348-8a61-dd54d93833b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:15:00 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dd2946-d6b6-47ae-ab68-7bdb841d5f99]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:00 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5 Jul 22 12:15:00 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:01 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5" returned: 0 in 0.419s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:01 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab Jul 22 12:15:01 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:01 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab" returned: 0 in 0.355s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:01 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab Jul 22 12:15:01 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:01 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5.7b2b270b-963c-4768-b136-d39e16c7deab" returned: 0 in 0.293s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Lock "cinder-quobyte-7b2b270b-963c-4768-b136-d39e16c7deab" released by "_delete_snapshot" :: held 1.572s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:01 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=126,cinder:UPDATE=157,cinder:INSERT=31,cinder:DELETE=11 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:15:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.602s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.280s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1384249972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75559ea4-eff1-4abb-9aa6-d17510c9d891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b245a6718341d48ec21569f1658d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:14:51Z,use_quota=True,user_id='efd9bc7381fa48009d35177da12861ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:15:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Creating volume 75559ea4-eff1-4abb-9aa6-d17510c9d891 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:15:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:15:01 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:15:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:01 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891 1073741824 Jul 22 12:15:01 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:02 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-930bffc5-f774-4418-a845-ff8373b8d414 tempest-GroupsV314Test-543926491 None] Create group from source-group-10fe12a2-c690-4436-a854-dd713d8764a6 completed successfully. Jul 22 12:15:02 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891 1073741824" returned: 0 in 0.564s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:02 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891 Jul 22 12:15:02 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f092d938-46c9-4634-92df-458b94891da7 tempest-GroupsV314Test-543926491 None] Acquiring lock "cinder-quobyte-2a8c80b4-3637-4b9f-bce1-114f95d34cfb" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f092d938-46c9-4634-92df-458b94891da7 tempest-GroupsV314Test-543926491 None] Lock "cinder-quobyte-2a8c80b4-3637-4b9f-bce1-114f95d34cfb" acquired by "delete_volume" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5793b00-ff1b-4100-b7ef-72a9439bdc44]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f092d938-46c9-4634-92df-458b94891da7 tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2a8c80b4-3637-4b9f-bce1-114f95d34cfb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:02 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891" returned: 0 in 0.311s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.811s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-107292448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f799a2-0a56-42a4-bcca-83df999e1581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58917ad1b6154de9a849d1a561d61131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:14:58Z,use_quota=True,user_id='04e295e5c09b45829ea3fbfd2feea9bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Creating volume 64f799a2-0a56-42a4-bcca-83df999e1581 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:15:02 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64f799a2-0a56-42a4-bcca-83df999e1581 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:02 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64f799a2-0a56-42a4-bcca-83df999e1581 1073741824 Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d1df06-f0d7-4a03-aa02-100d5b835149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75559ea4-eff1-4abb-9aa6-d17510c9d891', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:02 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a920367f-80a0-4c39-8a85-6402f0142b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:02 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2a8c80b4-3637-4b9f-bce1-114f95d34cfb Jul 22 12:15:02 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:02 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Volume volume-75559ea4-eff1-4abb-9aa6-d17510c9d891 (75559ea4-eff1-4abb-9aa6-d17510c9d891): created successfully Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a920367f-80a0-4c39-8a85-6402f0142b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Flow 'volume_create_manager' (60d3630c-ed52-4bc7-bddb-b5fa38945b2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:02 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d41b7079-1e67-4e32-850b-667f5802869d tempest-SnapshotsActionsTest-1286604923 None] Created volume successfully. Jul 22 12:15:03 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f092d938-46c9-4634-92df-458b94891da7 tempest-GroupsV314Test-543926491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2a8c80b4-3637-4b9f-bce1-114f95d34cfb" returned: 0 in 0.517s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f092d938-46c9-4634-92df-458b94891da7 tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2a8c80b4-3637-4b9f-bce1-114f95d34cfb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:03 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2a8c80b4-3637-4b9f-bce1-114f95d34cfb Jul 22 12:15:03 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8c379890-c342-4c34-88fa-ae07cf837b04 tempest-SnapshotsActionsTest-1286604923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:03 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64f799a2-0a56-42a4-bcca-83df999e1581 1073741824" returned: 0 in 0.673s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64f799a2-0a56-42a4-bcca-83df999e1581 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:03 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64f799a2-0a56-42a4-bcca-83df999e1581 Jul 22 12:15:03 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:03 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f092d938-46c9-4634-92df-458b94891da7 tempest-GroupsV314Test-543926491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2a8c80b4-3637-4b9f-bce1-114f95d34cfb" returned: 0 in 0.329s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:03 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f092d938-46c9-4634-92df-458b94891da7 tempest-GroupsV314Test-543926491 None] Lock "cinder-quobyte-2a8c80b4-3637-4b9f-bce1-114f95d34cfb" released by "delete_volume" :: held 0.914s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:03 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-f092d938-46c9-4634-92df-458b94891da7 tempest-GroupsV314Test-543926491 None] Created reservations ['88a2f115-9343-4751-bc19-9936d3f8c092'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:03 devstack cinder-volume[87568]: WARNING cinder.quota [None req-f092d938-46c9-4634-92df-458b94891da7 tempest-GroupsV314Test-543926491 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-104028256 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-104028256, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:15:03 devstack cinder-volume[87568]: WARNING cinder.quota [None req-f092d938-46c9-4634-92df-458b94891da7 tempest-GroupsV314Test-543926491 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-104028256 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-104028256, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:15:03 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-f092d938-46c9-4634-92df-458b94891da7 tempest-GroupsV314Test-543926491 None] Created reservations ['96291cc0-fef2-40e4-92a2-f8c18c35670f', 'c27d3dbb-b6f7-4fc4-b8a9-66f584fdb4fd', 'eb6d8b7f-0a9b-486a-aa8f-a0af8cfe2154', '0a465a1b-18ea-4989-9d2e-07f4008dc2a7'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:03 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64f799a2-0a56-42a4-bcca-83df999e1581" returned: 0 in 0.292s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:03 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:15:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8c379890-c342-4c34-88fa-ae07cf837b04 tempest-SnapshotsActionsTest-1286604923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.411s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0dda11-64cf-4e3f-a5b1-8c476b89ab47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64f799a2-0a56-42a4-bcca-83df999e1581', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39af9728-6f17-4ab1-9e60-13933b82b246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:03 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-8c379890-c342-4c34-88fa-ae07cf837b04 tempest-SnapshotsActionsTest-1286604923 None] Creating offline snapshot 0c753739-09d9-441f-8d75-46d2c7fac5c4 of volume 75559ea4-eff1-4abb-9aa6-d17510c9d891 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:15:03 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Volume volume-64f799a2-0a56-42a4-bcca-83df999e1581 (64f799a2-0a56-42a4-bcca-83df999e1581): created successfully Jul 22 12:15:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39af9728-6f17-4ab1-9e60-13933b82b246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Flow 'volume_create_manager' (bb270692-4e9c-4270-b0e4-e16850562d09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:03 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[50117c25-951f-436c-b260-bed265f99a5d]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8c379890-c342-4c34-88fa-ae07cf837b04 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:03 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-4c2543e4-175d-4cbb-b516-116d96ade813 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Created volume successfully. Jul 22 12:15:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f092d938-46c9-4634-92df-458b94891da7 tempest-GroupsV314Test-543926491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f092d938-46c9-4634-92df-458b94891da7 tempest-GroupsV314Test-543926491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:04 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f092d938-46c9-4634-92df-458b94891da7 tempest-GroupsV314Test-543926491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:04 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f092d938-46c9-4634-92df-458b94891da7 tempest-GroupsV314Test-543926491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f092d938-46c9-4634-92df-458b94891da7 tempest-GroupsV314Test-543926491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f092d938-46c9-4634-92df-458b94891da7 tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:04 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891 Jul 22 12:15:04 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:04 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:15:04 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:04 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f092d938-46c9-4634-92df-458b94891da7 tempest-GroupsV314Test-543926491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.346s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:04 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-f092d938-46c9-4634-92df-458b94891da7 tempest-GroupsV314Test-543926491 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:15:04 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-f092d938-46c9-4634-92df-458b94891da7 tempest-GroupsV314Test-543926491 None] Delete group completed successfully. Jul 22 12:15:04 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8c379890-c342-4c34-88fa-ae07cf837b04 tempest-SnapshotsActionsTest-1286604923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891" returned: 0 in 0.507s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8c379890-c342-4c34-88fa-ae07cf837b04 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:04 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 1G Jul 22 12:15:04 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:04 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8c379890-c342-4c34-88fa-ae07cf837b04 tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 1G" returned: 0 in 0.445s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8c379890-c342-4c34-88fa-ae07cf837b04 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75559ea4-eff1-4abb-9aa6-d17510c9d891 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:04 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75559ea4-eff1-4abb-9aa6-d17510c9d891 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 Jul 22 12:15:04 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:05 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8c379890-c342-4c34-88fa-ae07cf837b04 tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75559ea4-eff1-4abb-9aa6-d17510c9d891 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4" returned: 0 in 0.357s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:05 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-8c379890-c342-4c34-88fa-ae07cf837b04 tempest-SnapshotsActionsTest-1286604923 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 is being set with open permissions: ugo+rw Jul 22 12:15:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8c379890-c342-4c34-88fa-ae07cf837b04 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:05 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 Jul 22 12:15:05 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f93e4e46-eaac-4319-85ac-0135baff145c tempest-GroupsV314Test-543926491 None] Acquiring lock "cinder-quobyte-98018077-7390-4348-8a61-dd54d93833b5" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f93e4e46-eaac-4319-85ac-0135baff145c tempest-GroupsV314Test-543926491 None] Lock "cinder-quobyte-98018077-7390-4348-8a61-dd54d93833b5" acquired by "delete_volume" :: waited 0.034s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:05 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d57699-0d78-4ad5-af2a-528a68a3e849]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f93e4e46-eaac-4319-85ac-0135baff145c tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e78fbddf-92be-45ce-aa6f-7770d125ec87 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Acquiring lock "cinder-64f799a2-0a56-42a4-bcca-83df999e1581-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e78fbddf-92be-45ce-aa6f-7770d125ec87 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Lock "cinder-64f799a2-0a56-42a4-bcca-83df999e1581-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e78fbddf-92be-45ce-aa6f-7770d125ec87 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Acquiring lock "cinder-quobyte-64f799a2-0a56-42a4-bcca-83df999e1581" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e78fbddf-92be-45ce-aa6f-7770d125ec87 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Lock "cinder-quobyte-64f799a2-0a56-42a4-bcca-83df999e1581" acquired by "delete_volume" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:05 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:05 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[62de19df-3150-4de3-af07-5752b3b123a8]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e78fbddf-92be-45ce-aa6f-7770d125ec87 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64f799a2-0a56-42a4-bcca-83df999e1581 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:05 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5 Jul 22 12:15:05 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8c379890-c342-4c34-88fa-ae07cf837b04 tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4" returned: 0 in 0.367s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8c379890-c342-4c34-88fa-ae07cf837b04 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:05 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.info Jul 22 12:15:05 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:05 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64f799a2-0a56-42a4-bcca-83df999e1581 Jul 22 12:15:05 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:05 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8c379890-c342-4c34-88fa-ae07cf837b04 tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.info" returned: 0 in 0.263s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:05 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-8c379890-c342-4c34-88fa-ae07cf837b04 tempest-SnapshotsActionsTest-1286604923 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.info is being set with open permissions: ugo+rw Jul 22 12:15:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8c379890-c342-4c34-88fa-ae07cf837b04 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:05 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f93e4e46-eaac-4319-85ac-0135baff145c tempest-GroupsV314Test-543926491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5" returned: 0 in 0.532s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f93e4e46-eaac-4319-85ac-0135baff145c tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:05 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.info Jul 22 12:15:05 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:05 devstack sudo[95673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5 Jul 22 12:15:05 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:06 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e78fbddf-92be-45ce-aa6f-7770d125ec87 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64f799a2-0a56-42a4-bcca-83df999e1581" returned: 0 in 0.472s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e78fbddf-92be-45ce-aa6f-7770d125ec87 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64f799a2-0a56-42a4-bcca-83df999e1581 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:06 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64f799a2-0a56-42a4-bcca-83df999e1581 Jul 22 12:15:06 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:06 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f93e4e46-eaac-4319-85ac-0135baff145c tempest-GroupsV314Test-543926491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-98018077-7390-4348-8a61-dd54d93833b5" returned: 0 in 0.271s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:06 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8c379890-c342-4c34-88fa-ae07cf837b04 tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.info" returned: 0 in 0.310s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8c379890-c342-4c34-88fa-ae07cf837b04 tempest-SnapshotsActionsTest-1286604923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.399s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f93e4e46-eaac-4319-85ac-0135baff145c tempest-GroupsV314Test-543926491 None] Lock "cinder-quobyte-98018077-7390-4348-8a61-dd54d93833b5" released by "delete_volume" :: held 0.910s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:06 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-8c379890-c342-4c34-88fa-ae07cf837b04 tempest-SnapshotsActionsTest-1286604923 None] Create snapshot completed successfully Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-f93e4e46-eaac-4319-85ac-0135baff145c tempest-GroupsV314Test-543926491 None] Created reservations ['e16760fe-16a1-4db6-b8bb-a897576963db'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:06 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e78fbddf-92be-45ce-aa6f-7770d125ec87 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64f799a2-0a56-42a4-bcca-83df999e1581" returned: 0 in 0.290s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-f93e4e46-eaac-4319-85ac-0135baff145c tempest-GroupsV314Test-543926491 None] Created reservations ['6b3703fb-8f9b-4e63-871d-6677780584ca', '0eeaf7e7-e3c3-499b-8a8b-cb2491ee7471', '8dd81d9c-1cb0-4c65-a26e-872e46adff6b', '15504ca7-c7f7-4e9f-bddc-4d222f823a5f'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e78fbddf-92be-45ce-aa6f-7770d125ec87 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Lock "cinder-quobyte-64f799a2-0a56-42a4-bcca-83df999e1581" released by "delete_volume" :: held 0.820s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-e78fbddf-92be-45ce-aa6f-7770d125ec87 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Created reservations ['64ce6923-50ff-4c81-b76f-30e1487e546c', 'a93cb680-ee76-4c70-952a-3fec7e9e52c1', 'f07869ed-8fbd-4f59-9eb5-675d0a2baf6c', '3249f17f-1b6c-4b0e-b774-97968032284f'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f93e4e46-eaac-4319-85ac-0135baff145c tempest-GroupsV314Test-543926491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f93e4e46-eaac-4319-85ac-0135baff145c tempest-GroupsV314Test-543926491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f93e4e46-eaac-4319-85ac-0135baff145c tempest-GroupsV314Test-543926491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f93e4e46-eaac-4319-85ac-0135baff145c tempest-GroupsV314Test-543926491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f93e4e46-eaac-4319-85ac-0135baff145c tempest-GroupsV314Test-543926491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f93e4e46-eaac-4319-85ac-0135baff145c tempest-GroupsV314Test-543926491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:06 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:15:06 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e78fbddf-92be-45ce-aa6f-7770d125ec87 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e78fbddf-92be-45ce-aa6f-7770d125ec87 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e78fbddf-92be-45ce-aa6f-7770d125ec87 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e78fbddf-92be-45ce-aa6f-7770d125ec87 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e78fbddf-92be-45ce-aa6f-7770d125ec87 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e78fbddf-92be-45ce-aa6f-7770d125ec87 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:06 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:15:06 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:06 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f93e4e46-eaac-4319-85ac-0135baff145c tempest-GroupsV314Test-543926491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.331s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:06 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-f93e4e46-eaac-4319-85ac-0135baff145c tempest-GroupsV314Test-543926491 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:15:06 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-f93e4e46-eaac-4319-85ac-0135baff145c tempest-GroupsV314Test-543926491 None] Delete group completed successfully. Jul 22 12:15:06 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e78fbddf-92be-45ce-aa6f-7770d125ec87 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.408s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:07 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-e78fbddf-92be-45ce-aa6f-7770d125ec87 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:15:07 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e78fbddf-92be-45ce-aa6f-7770d125ec87 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Deleted volume successfully. Jul 22 12:15:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e78fbddf-92be-45ce-aa6f-7770d125ec87 tempest-VolumeQuotasNegativeTestJSON-1227296560 None] Lock "cinder-64f799a2-0a56-42a4-bcca-83df999e1581-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6c66e1ea-ba9a-449d-9947-74ef066c9215 tempest-SnapshotsActionsTest-1286604923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6c66e1ea-ba9a-449d-9947-74ef066c9215 tempest-SnapshotsActionsTest-1286604923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-6c66e1ea-ba9a-449d-9947-74ef066c9215 tempest-SnapshotsActionsTest-1286604923 None] Creating offline snapshot e3af9df6-86e7-426b-9e49-c7f9fef276e2 of volume 75559ea4-eff1-4abb-9aa6-d17510c9d891 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:15:07 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1634e41-9ae1-4be8-be0a-7a96eead2e8f]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6c66e1ea-ba9a-449d-9947-74ef066c9215 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:08 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 Jul 22 12:15:08 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:08 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6c66e1ea-ba9a-449d-9947-74ef066c9215 tempest-SnapshotsActionsTest-1286604923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4" returned: 0 in 0.477s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-6c66e1ea-ba9a-449d-9947-74ef066c9215 tempest-SnapshotsActionsTest-1286604923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75559ea4-eff1-4abb-9aa6-d17510c9d891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:15:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6c66e1ea-ba9a-449d-9947-74ef066c9215 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.e3af9df6-86e7-426b-9e49-c7f9fef276e2 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:08 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.e3af9df6-86e7-426b-9e49-c7f9fef276e2 1G Jul 22 12:15:08 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:09 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6c66e1ea-ba9a-449d-9947-74ef066c9215 tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.e3af9df6-86e7-426b-9e49-c7f9fef276e2 1G" returned: 0 in 0.724s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6c66e1ea-ba9a-449d-9947-74ef066c9215 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.e3af9df6-86e7-426b-9e49-c7f9fef276e2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:09 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.e3af9df6-86e7-426b-9e49-c7f9fef276e2 Jul 22 12:15:09 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:09 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6c66e1ea-ba9a-449d-9947-74ef066c9215 tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.e3af9df6-86e7-426b-9e49-c7f9fef276e2" returned: 0 in 0.427s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:09 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-6c66e1ea-ba9a-449d-9947-74ef066c9215 tempest-SnapshotsActionsTest-1286604923 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.e3af9df6-86e7-426b-9e49-c7f9fef276e2 is being set with open permissions: ugo+rw Jul 22 12:15:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6c66e1ea-ba9a-449d-9947-74ef066c9215 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.e3af9df6-86e7-426b-9e49-c7f9fef276e2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:09 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.e3af9df6-86e7-426b-9e49-c7f9fef276e2 Jul 22 12:15:09 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:09 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6c66e1ea-ba9a-449d-9947-74ef066c9215 tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.e3af9df6-86e7-426b-9e49-c7f9fef276e2" returned: 0 in 0.307s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6c66e1ea-ba9a-449d-9947-74ef066c9215 tempest-SnapshotsActionsTest-1286604923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.125s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:09 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-6c66e1ea-ba9a-449d-9947-74ef066c9215 tempest-SnapshotsActionsTest-1286604923 None] Create snapshot completed successfully Jul 22 12:15:11 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] Acquiring lock "cinder-e3af9df6-86e7-426b-9e49-c7f9fef276e2-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:11 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-e3af9df6-86e7-426b-9e49-c7f9fef276e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:11 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] Acquiring lock "cinder-quobyte-75559ea4-eff1-4abb-9aa6-d17510c9d891" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:11 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-quobyte-75559ea4-eff1-4abb-9aa6-d17510c9d891" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:11 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] Acquiring lock "cinder-quobyte-e3af9df6-86e7-426b-9e49-c7f9fef276e2" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:11 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-quobyte-e3af9df6-86e7-426b-9e49-c7f9fef276e2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] Deleting offline snapshot e3af9df6-86e7-426b-9e49-c7f9fef276e2 of volume 75559ea4-eff1-4abb-9aa6-d17510c9d891 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:15:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] snapshot_file for this snap is: volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.e3af9df6-86e7-426b-9e49-c7f9fef276e2 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:15:11 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[593f1040-3cd9-4792-98d8-cb468eff32cf]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.e3af9df6-86e7-426b-9e49-c7f9fef276e2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:11 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.e3af9df6-86e7-426b-9e49-c7f9fef276e2 Jul 22 12:15:11 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:11 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.e3af9df6-86e7-426b-9e49-c7f9fef276e2" returned: 0 in 0.435s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75559ea4-eff1-4abb-9aa6-d17510c9d891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:15:11 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[2477c7e6-70f2-4317-aa63-fd2533fe5846]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:11 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-a809d494-6eeb-4f91-8cf6-7e7ae5ac9deb tempest-GroupsV320Test-856322576 None] Group tempest-GroupsV320Test-Group-166026287: creating Jul 22 12:15:11 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-a809d494-6eeb-4f91-8cf6-7e7ae5ac9deb tempest-GroupsV320Test-856322576 None] Group tempest-GroupsV320Test-Group-166026287: created successfully Jul 22 12:15:11 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-a809d494-6eeb-4f91-8cf6-7e7ae5ac9deb tempest-GroupsV320Test-856322576 None] Create group completed successfully. Jul 22 12:15:11 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 Jul 22 12:15:11 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:12 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4" returned: 0 in 0.448s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75559ea4-eff1-4abb-9aa6-d17510c9d891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:15:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.e3af9df6-86e7-426b-9e49-c7f9fef276e2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:12 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.e3af9df6-86e7-426b-9e49-c7f9fef276e2 Jul 22 12:15:12 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:12 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.e3af9df6-86e7-426b-9e49-c7f9fef276e2" returned: 0 in 0.404s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.e3af9df6-86e7-426b-9e49-c7f9fef276e2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:12 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.e3af9df6-86e7-426b-9e49-c7f9fef276e2 Jul 22 12:15:12 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:12 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.e3af9df6-86e7-426b-9e49-c7f9fef276e2" returned: 0 in 0.275s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-quobyte-e3af9df6-86e7-426b-9e49-c7f9fef276e2" released by "_delete_snapshot" :: held 1.727s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-quobyte-75559ea4-eff1-4abb-9aa6-d17510c9d891" released by "delete_snapshot" :: held 1.757s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:12 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] Created reservations ['ad2daf0c-2a5e-4804-8a78-805d7e843763', '24c05bcf-35b8-4b9d-a241-65627eb03e1c', 'a209f80e-c7ad-4495-bed0-9656628909e2', '6413c81d-8a05-4d3d-84ab-d39e4b83ccdf'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:13 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] Delete snapshot completed successfully. Jul 22 12:15:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a4bba7db-826c-40a3-a2e1-488f63b4a45b tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-e3af9df6-86e7-426b-9e49-c7f9fef276e2-delete_snapshot" released by "delete_snapshot" :: held 1.960s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-05f24f26-2041-42d2-aeeb-e7d165e00684 tempest-SnapshotsActionsTest-1286604923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-05f24f26-2041-42d2-aeeb-e7d165e00684 tempest-SnapshotsActionsTest-1286604923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:13 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-9796dfa2-c9fe-4a42-a0ec-bd55fcb629ee tempest-GroupsV320Test-856322576 None] Created reservations ['c794323f-07b9-4a6e-a2a6-9db66badaeae'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-05f24f26-2041-42d2-aeeb-e7d165e00684 tempest-SnapshotsActionsTest-1286604923 None] Creating offline snapshot 0cf4f4fb-3d0d-402d-b3b2-f086dedc5794 of volume 75559ea4-eff1-4abb-9aa6-d17510c9d891 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:15:13 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd2ccbc-c06f-4fee-8ae6-fba0deedfae8]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-05f24f26-2041-42d2-aeeb-e7d165e00684 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9796dfa2-c9fe-4a42-a0ec-bd55fcb629ee tempest-GroupsV320Test-856322576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9796dfa2-c9fe-4a42-a0ec-bd55fcb629ee tempest-GroupsV320Test-856322576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9796dfa2-c9fe-4a42-a0ec-bd55fcb629ee tempest-GroupsV320Test-856322576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9796dfa2-c9fe-4a42-a0ec-bd55fcb629ee tempest-GroupsV320Test-856322576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9796dfa2-c9fe-4a42-a0ec-bd55fcb629ee tempest-GroupsV320Test-856322576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9796dfa2-c9fe-4a42-a0ec-bd55fcb629ee tempest-GroupsV320Test-856322576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:13 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:15:13 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:14 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 Jul 22 12:15:14 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:14 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9796dfa2-c9fe-4a42-a0ec-bd55fcb629ee tempest-GroupsV320Test-856322576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.351s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:14 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-9796dfa2-c9fe-4a42-a0ec-bd55fcb629ee tempest-GroupsV320Test-856322576 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:15:14 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-9796dfa2-c9fe-4a42-a0ec-bd55fcb629ee tempest-GroupsV320Test-856322576 None] Delete group completed successfully. Jul 22 12:15:14 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-05f24f26-2041-42d2-aeeb-e7d165e00684 tempest-SnapshotsActionsTest-1286604923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4" returned: 0 in 0.533s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-05f24f26-2041-42d2-aeeb-e7d165e00684 tempest-SnapshotsActionsTest-1286604923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75559ea4-eff1-4abb-9aa6-d17510c9d891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:15:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-05f24f26-2041-42d2-aeeb-e7d165e00684 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0cf4f4fb-3d0d-402d-b3b2-f086dedc5794 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:14 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0cf4f4fb-3d0d-402d-b3b2-f086dedc5794 1G Jul 22 12:15:14 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:14 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:15:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Flow 'volume_create_manager' (dfab21d7-daa3-4ce1-9c55-75e29910457d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a284ecc4-d354-4a44-9cc9-d769c96e5438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a284ecc4-d354-4a44-9cc9-d769c96e5438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2074372403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b416e3-40c2-49da-a3e3-3164f75263e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca59feafb4434a78a573b3afb6793c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:15:15Z,use_quota=True,user_id='62f47209df2848ce8f182f60d1e1bc28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e37e547-7cb8-44e5-b3a4-580377daa4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e37e547-7cb8-44e5-b3a4-580377daa4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5090cc8-cb1b-402b-a601-9b091aae4f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5090cc8-cb1b-402b-a601-9b091aae4f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44b416e3-40c2-49da-a3e3-3164f75263e5', 'volume_name': 'volume-44b416e3-40c2-49da-a3e3-3164f75263e5', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16183cd-131d-4298-8703-611c591ac754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16183cd-131d-4298-8703-611c591ac754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f61027b-6a6d-49b4-871a-163dd521bfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:14 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Volume 44b416e3-40c2-49da-a3e3-3164f75263e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44b416e3-40c2-49da-a3e3-3164f75263e5', 'volume_size': 1} Jul 22 12:15:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:14 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-05f24f26-2041-42d2-aeeb-e7d165e00684 tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0cf4f4fb-3d0d-402d-b3b2-f086dedc5794 1G" returned: 0 in 0.560s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-05f24f26-2041-42d2-aeeb-e7d165e00684 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0cf4f4fb-3d0d-402d-b3b2-f086dedc5794 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:14 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0cf4f4fb-3d0d-402d-b3b2-f086dedc5794 Jul 22 12:15:14 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:15 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-05f24f26-2041-42d2-aeeb-e7d165e00684 tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0cf4f4fb-3d0d-402d-b3b2-f086dedc5794" returned: 0 in 0.341s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:15 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-05f24f26-2041-42d2-aeeb-e7d165e00684 tempest-SnapshotsActionsTest-1286604923 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0cf4f4fb-3d0d-402d-b3b2-f086dedc5794 is being set with open permissions: ugo+rw Jul 22 12:15:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-05f24f26-2041-42d2-aeeb-e7d165e00684 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0cf4f4fb-3d0d-402d-b3b2-f086dedc5794 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:15 devstack sudo[95791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0cf4f4fb-3d0d-402d-b3b2-f086dedc5794 Jul 22 12:15:15 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:15 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-05f24f26-2041-42d2-aeeb-e7d165e00684 tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0cf4f4fb-3d0d-402d-b3b2-f086dedc5794" returned: 0 in 0.263s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-05f24f26-2041-42d2-aeeb-e7d165e00684 tempest-SnapshotsActionsTest-1286604923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.841s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.733s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:15 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2074372403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b416e3-40c2-49da-a3e3-3164f75263e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca59feafb4434a78a573b3afb6793c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:15:15Z,use_quota=True,user_id='62f47209df2848ce8f182f60d1e1bc28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:15:15 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Creating volume 44b416e3-40c2-49da-a3e3-3164f75263e5 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:15:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:15 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:15 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:15 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:15:15 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:15:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-44b416e3-40c2-49da-a3e3-3164f75263e5 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:15 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-44b416e3-40c2-49da-a3e3-3164f75263e5 1073741824 Jul 22 12:15:15 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:15 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-05f24f26-2041-42d2-aeeb-e7d165e00684 tempest-SnapshotsActionsTest-1286604923 None] Create snapshot completed successfully Jul 22 12:15:16 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-44b416e3-40c2-49da-a3e3-3164f75263e5 1073741824" returned: 0 in 0.560s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-44b416e3-40c2-49da-a3e3-3164f75263e5 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] Acquiring lock "cinder-0cf4f4fb-3d0d-402d-b3b2-f086dedc5794-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:16 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-44b416e3-40c2-49da-a3e3-3164f75263e5 Jul 22 12:15:16 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-0cf4f4fb-3d0d-402d-b3b2-f086dedc5794-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] Acquiring lock "cinder-quobyte-75559ea4-eff1-4abb-9aa6-d17510c9d891" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-quobyte-75559ea4-eff1-4abb-9aa6-d17510c9d891" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] Acquiring lock "cinder-quobyte-0cf4f4fb-3d0d-402d-b3b2-f086dedc5794" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-quobyte-0cf4f4fb-3d0d-402d-b3b2-f086dedc5794" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] Deleting offline snapshot 0cf4f4fb-3d0d-402d-b3b2-f086dedc5794 of volume 75559ea4-eff1-4abb-9aa6-d17510c9d891 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:15:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] snapshot_file for this snap is: volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0cf4f4fb-3d0d-402d-b3b2-f086dedc5794 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:15:16 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c642b44-6862-4641-82a2-c08efbf528b8]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0cf4f4fb-3d0d-402d-b3b2-f086dedc5794 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:16 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0cf4f4fb-3d0d-402d-b3b2-f086dedc5794 Jul 22 12:15:16 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:16 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-44b416e3-40c2-49da-a3e3-3164f75263e5" returned: 0 in 0.505s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:15:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f61027b-6a6d-49b4-871a-163dd521bfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44b416e3-40c2-49da-a3e3-3164f75263e5', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7afe5bfc-8cde-43ca-b3ad-9deb46ba9b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:16 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Volume volume-44b416e3-40c2-49da-a3e3-3164f75263e5 (44b416e3-40c2-49da-a3e3-3164f75263e5): created successfully Jul 22 12:15:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7afe5bfc-8cde-43ca-b3ad-9deb46ba9b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Flow 'volume_create_manager' (dfab21d7-daa3-4ce1-9c55-75e29910457d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:16 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d54bf219-7a4a-4708-b9fb-21e525d74076 tempest-VolumesServicesTestJSON-1701938715 None] Created volume successfully. Jul 22 12:15:16 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0cf4f4fb-3d0d-402d-b3b2-f086dedc5794" returned: 0 in 0.579s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75559ea4-eff1-4abb-9aa6-d17510c9d891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:15:17 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bef82d-0215-4d92-b7f1-c931067f62b4]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:17 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 Jul 22 12:15:17 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:17 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4" returned: 0 in 0.424s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75559ea4-eff1-4abb-9aa6-d17510c9d891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:15:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0cf4f4fb-3d0d-402d-b3b2-f086dedc5794 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:17 devstack sudo[95814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0cf4f4fb-3d0d-402d-b3b2-f086dedc5794 Jul 22 12:15:17 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:17 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0cf4f4fb-3d0d-402d-b3b2-f086dedc5794" returned: 0 in 0.494s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0cf4f4fb-3d0d-402d-b3b2-f086dedc5794 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:17 devstack sudo[95820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0cf4f4fb-3d0d-402d-b3b2-f086dedc5794 Jul 22 12:15:17 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:18 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ba04f596-ccac-4442-9519-75bfd2d485d1 tempest-VolumesServicesTestJSON-1701938715 None] Acquiring lock "cinder-44b416e3-40c2-49da-a3e3-3164f75263e5-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:18 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0cf4f4fb-3d0d-402d-b3b2-f086dedc5794" returned: 0 in 0.308s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:18 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ba04f596-ccac-4442-9519-75bfd2d485d1 tempest-VolumesServicesTestJSON-1701938715 None] Lock "cinder-44b416e3-40c2-49da-a3e3-3164f75263e5-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:18 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-quobyte-0cf4f4fb-3d0d-402d-b3b2-f086dedc5794" released by "_delete_snapshot" :: held 1.978s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:18 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-quobyte-75559ea4-eff1-4abb-9aa6-d17510c9d891" released by "delete_snapshot" :: held 2.005s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:18 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ba04f596-ccac-4442-9519-75bfd2d485d1 tempest-VolumesServicesTestJSON-1701938715 None] Acquiring lock "cinder-quobyte-44b416e3-40c2-49da-a3e3-3164f75263e5" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:18 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ba04f596-ccac-4442-9519-75bfd2d485d1 tempest-VolumesServicesTestJSON-1701938715 None] Lock "cinder-quobyte-44b416e3-40c2-49da-a3e3-3164f75263e5" acquired by "delete_volume" :: waited 0.023s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:18 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc856f6a-0fc4-4268-8707-edb38754bb91]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ba04f596-ccac-4442-9519-75bfd2d485d1 tempest-VolumesServicesTestJSON-1701938715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-44b416e3-40c2-49da-a3e3-3164f75263e5 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:18 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] Created reservations ['646f54cc-3e2f-4bcf-8832-c552c80e1a83', '5e99b0c1-9509-411d-bd50-4925462e8d26', '1e657ada-c6bc-491e-bc9e-24f3996baddd', 'c1660f70-2f37-43db-a82b-6ef2ee48e434'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:18 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] Delete snapshot completed successfully. Jul 22 12:15:18 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6d9be817-0463-4c43-9b44-27207fcdf4a9 tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-0cf4f4fb-3d0d-402d-b3b2-f086dedc5794-delete_snapshot" released by "delete_snapshot" :: held 2.251s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:18 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-44b416e3-40c2-49da-a3e3-3164f75263e5 Jul 22 12:15:18 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:18 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ba04f596-ccac-4442-9519-75bfd2d485d1 tempest-VolumesServicesTestJSON-1701938715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-44b416e3-40c2-49da-a3e3-3164f75263e5" returned: 0 in 0.430s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ba04f596-ccac-4442-9519-75bfd2d485d1 tempest-VolumesServicesTestJSON-1701938715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-44b416e3-40c2-49da-a3e3-3164f75263e5 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:18 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-44b416e3-40c2-49da-a3e3-3164f75263e5 Jul 22 12:15:18 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:19 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ba04f596-ccac-4442-9519-75bfd2d485d1 tempest-VolumesServicesTestJSON-1701938715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-44b416e3-40c2-49da-a3e3-3164f75263e5" returned: 0 in 0.314s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ba04f596-ccac-4442-9519-75bfd2d485d1 tempest-VolumesServicesTestJSON-1701938715 None] Lock "cinder-quobyte-44b416e3-40c2-49da-a3e3-3164f75263e5" released by "delete_volume" :: held 0.798s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:19 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-ba04f596-ccac-4442-9519-75bfd2d485d1 tempest-VolumesServicesTestJSON-1701938715 None] Created reservations ['06f251db-e183-42b4-9396-0bde92d150eb', '1bcd3df8-caec-4841-a5e9-fe1506a74520', 'c944605b-acac-4845-930d-6f85f7a024fa', 'fb8b3db6-e6f6-48db-ba93-c48854cc3a9b'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ba04f596-ccac-4442-9519-75bfd2d485d1 tempest-VolumesServicesTestJSON-1701938715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ba04f596-ccac-4442-9519-75bfd2d485d1 tempest-VolumesServicesTestJSON-1701938715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ba04f596-ccac-4442-9519-75bfd2d485d1 tempest-VolumesServicesTestJSON-1701938715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ba04f596-ccac-4442-9519-75bfd2d485d1 tempest-VolumesServicesTestJSON-1701938715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ba04f596-ccac-4442-9519-75bfd2d485d1 tempest-VolumesServicesTestJSON-1701938715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ba04f596-ccac-4442-9519-75bfd2d485d1 tempest-VolumesServicesTestJSON-1701938715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:19 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:15:19 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:19 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ba04f596-ccac-4442-9519-75bfd2d485d1 tempest-VolumesServicesTestJSON-1701938715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.408s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:19 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-ba04f596-ccac-4442-9519-75bfd2d485d1 tempest-VolumesServicesTestJSON-1701938715 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:15:19 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-ba04f596-ccac-4442-9519-75bfd2d485d1 tempest-VolumesServicesTestJSON-1701938715 None] Deleted volume successfully. Jul 22 12:15:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ba04f596-ccac-4442-9519-75bfd2d485d1 tempest-VolumesServicesTestJSON-1701938715 None] Lock "cinder-44b416e3-40c2-49da-a3e3-3164f75263e5-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3626f148-cf18-4656-bb9f-7ff3665ef276 tempest-SnapshotsActionsTest-1286604923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3626f148-cf18-4656-bb9f-7ff3665ef276 tempest-SnapshotsActionsTest-1286604923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-3626f148-cf18-4656-bb9f-7ff3665ef276 tempest-SnapshotsActionsTest-1286604923 None] Creating offline snapshot 6c582fa9-aa61-4c5d-ae58-0a3479ee0613 of volume 75559ea4-eff1-4abb-9aa6-d17510c9d891 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:15:19 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3f7cbb-3d24-4b56-af51-0b0def42aa9c]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3626f148-cf18-4656-bb9f-7ff3665ef276 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:20 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 Jul 22 12:15:20 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:20 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3626f148-cf18-4656-bb9f-7ff3665ef276 tempest-SnapshotsActionsTest-1286604923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4" returned: 0 in 0.380s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:20 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-3626f148-cf18-4656-bb9f-7ff3665ef276 tempest-SnapshotsActionsTest-1286604923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75559ea4-eff1-4abb-9aa6-d17510c9d891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:15:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3626f148-cf18-4656-bb9f-7ff3665ef276 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.6c582fa9-aa61-4c5d-ae58-0a3479ee0613 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:20 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.6c582fa9-aa61-4c5d-ae58-0a3479ee0613 1G Jul 22 12:15:20 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:21 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3626f148-cf18-4656-bb9f-7ff3665ef276 tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.6c582fa9-aa61-4c5d-ae58-0a3479ee0613 1G" returned: 0 in 0.643s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3626f148-cf18-4656-bb9f-7ff3665ef276 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.6c582fa9-aa61-4c5d-ae58-0a3479ee0613 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:21 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.6c582fa9-aa61-4c5d-ae58-0a3479ee0613 Jul 22 12:15:21 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:21 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3626f148-cf18-4656-bb9f-7ff3665ef276 tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.6c582fa9-aa61-4c5d-ae58-0a3479ee0613" returned: 0 in 0.408s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:21 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-3626f148-cf18-4656-bb9f-7ff3665ef276 tempest-SnapshotsActionsTest-1286604923 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.6c582fa9-aa61-4c5d-ae58-0a3479ee0613 is being set with open permissions: ugo+rw Jul 22 12:15:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3626f148-cf18-4656-bb9f-7ff3665ef276 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.6c582fa9-aa61-4c5d-ae58-0a3479ee0613 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:21 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.6c582fa9-aa61-4c5d-ae58-0a3479ee0613 Jul 22 12:15:21 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:21 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3626f148-cf18-4656-bb9f-7ff3665ef276 tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.6c582fa9-aa61-4c5d-ae58-0a3479ee0613" returned: 0 in 0.294s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3626f148-cf18-4656-bb9f-7ff3665ef276 tempest-SnapshotsActionsTest-1286604923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.864s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:21 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-3626f148-cf18-4656-bb9f-7ff3665ef276 tempest-SnapshotsActionsTest-1286604923 None] Create snapshot completed successfully Jul 22 12:15:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] Acquiring lock "cinder-6c582fa9-aa61-4c5d-ae58-0a3479ee0613-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-6c582fa9-aa61-4c5d-ae58-0a3479ee0613-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] Acquiring lock "cinder-quobyte-75559ea4-eff1-4abb-9aa6-d17510c9d891" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-quobyte-75559ea4-eff1-4abb-9aa6-d17510c9d891" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] Acquiring lock "cinder-quobyte-6c582fa9-aa61-4c5d-ae58-0a3479ee0613" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-quobyte-6c582fa9-aa61-4c5d-ae58-0a3479ee0613" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] Deleting offline snapshot 6c582fa9-aa61-4c5d-ae58-0a3479ee0613 of volume 75559ea4-eff1-4abb-9aa6-d17510c9d891 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:15:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] snapshot_file for this snap is: volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.6c582fa9-aa61-4c5d-ae58-0a3479ee0613 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:15:22 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c90a39-c751-4fb4-ba2a-b6e829aa97cf]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.6c582fa9-aa61-4c5d-ae58-0a3479ee0613 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:22 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.6c582fa9-aa61-4c5d-ae58-0a3479ee0613 Jul 22 12:15:22 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:22 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.6c582fa9-aa61-4c5d-ae58-0a3479ee0613" returned: 0 in 0.477s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75559ea4-eff1-4abb-9aa6-d17510c9d891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:15:22 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[898620fe-4458-41bb-a058-a1f9bdad040a]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:22 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 Jul 22 12:15:22 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:23 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4" returned: 0 in 0.557s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75559ea4-eff1-4abb-9aa6-d17510c9d891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:15:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.6c582fa9-aa61-4c5d-ae58-0a3479ee0613 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:23 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.6c582fa9-aa61-4c5d-ae58-0a3479ee0613 Jul 22 12:15:23 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:23 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.6c582fa9-aa61-4c5d-ae58-0a3479ee0613" returned: 0 in 0.560s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.6c582fa9-aa61-4c5d-ae58-0a3479ee0613 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:23 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.6c582fa9-aa61-4c5d-ae58-0a3479ee0613 Jul 22 12:15:23 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Flow 'volume_create_manager' (7b49852b-5f67-42d6-a391-230f5ccbe9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c203a6-a1b7-4ed7-97ae-35be8a8f56fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c203a6-a1b7-4ed7-97ae-35be8a8f56fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-758730652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff52d4ae-b1af-40b5-a3cc-25a9e5df202a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e10999783b2c4f19bfa15cb00a73b470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:15:24Z,use_quota=True,user_id='34c525f75d4b4e8b8dbfd28270ede67d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fad296ff-e90a-454f-89d3-4fc552c7fe48),volume_type_id=fad296ff-e90a-454f-89d3-4fc552c7fe48)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (affe0daa-e6ea-477e-a76c-27dfc4b0a769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (affe0daa-e6ea-477e-a76c-27dfc4b0a769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8e3c4a-e1fa-4bb3-885b-4e6850f5d6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8e3c4a-e1fa-4bb3-885b-4e6850f5d6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff52d4ae-b1af-40b5-a3cc-25a9e5df202a', 'volume_name': 'volume-ff52d4ae-b1af-40b5-a3cc-25a9e5df202a', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd3cf92-1d4c-4f3f-a34a-4dac7bc5e531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd3cf92-1d4c-4f3f-a34a-4dac7bc5e531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75887efc-6fb6-4074-9a3f-9dd7d113a8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:24 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Volume ff52d4ae-b1af-40b5-a3cc-25a9e5df202a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff52d4ae-b1af-40b5-a3cc-25a9e5df202a', 'volume_size': 1} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-758730652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff52d4ae-b1af-40b5-a3cc-25a9e5df202a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e10999783b2c4f19bfa15cb00a73b470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:15:24Z,use_quota=True,user_id='34c525f75d4b4e8b8dbfd28270ede67d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fad296ff-e90a-454f-89d3-4fc552c7fe48),volume_type_id=fad296ff-e90a-454f-89d3-4fc552c7fe48)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Creating volume ff52d4ae-b1af-40b5-a3cc-25a9e5df202a {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:15:24 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ff52d4ae-b1af-40b5-a3cc-25a9e5df202a 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:24 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ff52d4ae-b1af-40b5-a3cc-25a9e5df202a 1073741824 Jul 22 12:15:24 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:24 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.6c582fa9-aa61-4c5d-ae58-0a3479ee0613" returned: 0 in 0.337s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-quobyte-6c582fa9-aa61-4c5d-ae58-0a3479ee0613" released by "_delete_snapshot" :: held 2.083s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-quobyte-75559ea4-eff1-4abb-9aa6-d17510c9d891" released by "delete_snapshot" :: held 2.110s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:24 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:15:24 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] Created reservations ['808348e6-ab22-4e4f-8aff-7839dafcd87b', '14c284be-d3f9-4ff5-95d5-6fc6aa8c8630', 'cdae265b-de1e-493f-96fb-cfc9e2010829', '2bd9a505-6af9-4993-8283-4e93db3d3c32'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:24 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] Delete snapshot completed successfully. Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-fb388c46-52ef-4f1a-94f4-5e2f07768fa6 tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-6c582fa9-aa61-4c5d-ae58-0a3479ee0613-delete_snapshot" released by "delete_snapshot" :: held 2.380s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:24 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.338s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread count: 8 {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread info: [<_MainThread(MainThread, started 137793405739136)>, , , , , , , ] {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:15:24 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ff52d4ae-b1af-40b5-a3cc-25a9e5df202a 1073741824" returned: 0 in 0.644s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ff52d4ae-b1af-40b5-a3cc-25a9e5df202a {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:24 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ff52d4ae-b1af-40b5-a3cc-25a9e5df202a Jul 22 12:15:24 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:25 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ff52d4ae-b1af-40b5-a3cc-25a9e5df202a" returned: 0 in 0.272s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:15:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75887efc-6fb6-4074-9a3f-9dd7d113a8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff52d4ae-b1af-40b5-a3cc-25a9e5df202a', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c17446-6d7e-4042-bcc7-0dd6cdabd6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:25 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Volume volume-ff52d4ae-b1af-40b5-a3cc-25a9e5df202a (ff52d4ae-b1af-40b5-a3cc-25a9e5df202a): created successfully Jul 22 12:15:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c17446-6d7e-4042-bcc7-0dd6cdabd6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Flow 'volume_create_manager' (7b49852b-5f67-42d6-a391-230f5ccbe9a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:25 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-f0744d84-4ae7-446f-84ba-58d92e3f4755 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Created volume successfully. Jul 22 12:15:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-af24d6b4-b287-4032-8bc7-55080f1b3a91 tempest-SnapshotsActionsTest-1286604923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-af24d6b4-b287-4032-8bc7-55080f1b3a91 tempest-SnapshotsActionsTest-1286604923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-af24d6b4-b287-4032-8bc7-55080f1b3a91 tempest-SnapshotsActionsTest-1286604923 None] Creating offline snapshot ffcee897-7932-489b-9f50-35be88af4af2 of volume 75559ea4-eff1-4abb-9aa6-d17510c9d891 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:15:25 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[50376ddb-4800-4c7a-8aaa-bba3146945d8]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-af24d6b4-b287-4032-8bc7-55080f1b3a91 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:25 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 Jul 22 12:15:25 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:26 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-af24d6b4-b287-4032-8bc7-55080f1b3a91 tempest-SnapshotsActionsTest-1286604923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4" returned: 0 in 0.400s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-af24d6b4-b287-4032-8bc7-55080f1b3a91 tempest-SnapshotsActionsTest-1286604923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75559ea4-eff1-4abb-9aa6-d17510c9d891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:15:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-af24d6b4-b287-4032-8bc7-55080f1b3a91 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.ffcee897-7932-489b-9f50-35be88af4af2 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:26 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.ffcee897-7932-489b-9f50-35be88af4af2 1G Jul 22 12:15:26 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-34c843c0-df6b-4bec-8919-d0274039ee0f tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-34c843c0-df6b-4bec-8919-d0274039ee0f tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-34c843c0-df6b-4bec-8919-d0274039ee0f tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-34c843c0-df6b-4bec-8919-d0274039ee0f tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-34c843c0-df6b-4bec-8919-d0274039ee0f tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-34c843c0-df6b-4bec-8919-d0274039ee0f tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:26 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:15:26 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:26 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-af24d6b4-b287-4032-8bc7-55080f1b3a91 tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.ffcee897-7932-489b-9f50-35be88af4af2 1G" returned: 0 in 0.631s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-af24d6b4-b287-4032-8bc7-55080f1b3a91 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.ffcee897-7932-489b-9f50-35be88af4af2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:26 devstack sudo[95902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.ffcee897-7932-489b-9f50-35be88af4af2 Jul 22 12:15:26 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:26 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-34c843c0-df6b-4bec-8919-d0274039ee0f tempest-VolumeRetypeWithoutMigrationTest-52277800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.361s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:26 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-34c843c0-df6b-4bec-8919-d0274039ee0f tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:15:26 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-34c843c0-df6b-4bec-8919-d0274039ee0f tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Retype volume completed successfully. Jul 22 12:15:27 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-af24d6b4-b287-4032-8bc7-55080f1b3a91 tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.ffcee897-7932-489b-9f50-35be88af4af2" returned: 0 in 0.320s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:27 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-af24d6b4-b287-4032-8bc7-55080f1b3a91 tempest-SnapshotsActionsTest-1286604923 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.ffcee897-7932-489b-9f50-35be88af4af2 is being set with open permissions: ugo+rw Jul 22 12:15:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-af24d6b4-b287-4032-8bc7-55080f1b3a91 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.ffcee897-7932-489b-9f50-35be88af4af2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:27 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.ffcee897-7932-489b-9f50-35be88af4af2 Jul 22 12:15:27 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:27 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-af24d6b4-b287-4032-8bc7-55080f1b3a91 tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.ffcee897-7932-489b-9f50-35be88af4af2" returned: 0 in 0.259s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-af24d6b4-b287-4032-8bc7-55080f1b3a91 tempest-SnapshotsActionsTest-1286604923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.736s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:27 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-af24d6b4-b287-4032-8bc7-55080f1b3a91 tempest-SnapshotsActionsTest-1286604923 None] Create snapshot completed successfully Jul 22 12:15:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-eabf0463-dc28-42f3-a4ad-0fc1f16a55c4 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Acquiring lock "cinder-ff52d4ae-b1af-40b5-a3cc-25a9e5df202a-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-eabf0463-dc28-42f3-a4ad-0fc1f16a55c4 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Lock "cinder-ff52d4ae-b1af-40b5-a3cc-25a9e5df202a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-eabf0463-dc28-42f3-a4ad-0fc1f16a55c4 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Acquiring lock "cinder-quobyte-ff52d4ae-b1af-40b5-a3cc-25a9e5df202a" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-eabf0463-dc28-42f3-a4ad-0fc1f16a55c4 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Lock "cinder-quobyte-ff52d4ae-b1af-40b5-a3cc-25a9e5df202a" acquired by "delete_volume" :: waited 0.026s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63ebe53-fdcd-4bb0-87bf-6cb2f51af639]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eabf0463-dc28-42f3-a4ad-0fc1f16a55c4 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ff52d4ae-b1af-40b5-a3cc-25a9e5df202a {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] Acquiring lock "cinder-ffcee897-7932-489b-9f50-35be88af4af2-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-ffcee897-7932-489b-9f50-35be88af4af2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] Acquiring lock "cinder-quobyte-75559ea4-eff1-4abb-9aa6-d17510c9d891" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-quobyte-75559ea4-eff1-4abb-9aa6-d17510c9d891" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] Acquiring lock "cinder-quobyte-ffcee897-7932-489b-9f50-35be88af4af2" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:28 devstack sudo[95911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ff52d4ae-b1af-40b5-a3cc-25a9e5df202a Jul 22 12:15:28 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-quobyte-ffcee897-7932-489b-9f50-35be88af4af2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] Deleting offline snapshot ffcee897-7932-489b-9f50-35be88af4af2 of volume 75559ea4-eff1-4abb-9aa6-d17510c9d891 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] snapshot_file for this snap is: volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.ffcee897-7932-489b-9f50-35be88af4af2 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40d083a-e0f1-4a88-beb3-f9c4593dbb5c]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.ffcee897-7932-489b-9f50-35be88af4af2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:28 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.ffcee897-7932-489b-9f50-35be88af4af2 Jul 22 12:15:28 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:28 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eabf0463-dc28-42f3-a4ad-0fc1f16a55c4 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ff52d4ae-b1af-40b5-a3cc-25a9e5df202a" returned: 0 in 0.504s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eabf0463-dc28-42f3-a4ad-0fc1f16a55c4 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ff52d4ae-b1af-40b5-a3cc-25a9e5df202a {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:28 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ff52d4ae-b1af-40b5-a3cc-25a9e5df202a Jul 22 12:15:28 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:28 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.ffcee897-7932-489b-9f50-35be88af4af2" returned: 0 in 0.478s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75559ea4-eff1-4abb-9aa6-d17510c9d891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[948b3605-0ebb-44d2-b485-ecd69fe9e60c]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:28 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eabf0463-dc28-42f3-a4ad-0fc1f16a55c4 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ff52d4ae-b1af-40b5-a3cc-25a9e5df202a" returned: 0 in 0.281s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-eabf0463-dc28-42f3-a4ad-0fc1f16a55c4 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Lock "cinder-quobyte-ff52d4ae-b1af-40b5-a3cc-25a9e5df202a" released by "delete_volume" :: held 0.839s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:28 devstack cinder-volume[87568]: WARNING cinder.quota [None req-eabf0463-dc28-42f3-a4ad-0fc1f16a55c4 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:15:28 devstack cinder-volume[87568]: WARNING cinder.quota [None req-eabf0463-dc28-42f3-a4ad-0fc1f16a55c4 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-eabf0463-dc28-42f3-a4ad-0fc1f16a55c4 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Created reservations ['d775c182-0cc8-45ca-a9d1-c4fdcdd19586', '6e7dce3b-790b-4068-ba05-1adcf4e672dd', '5eb2d3cc-7c28-431e-94b1-f5df613bd03d', 'd6316d4f-d26d-45b9-916c-ac21a9d3064e'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:28 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 Jul 22 12:15:28 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-eabf0463-dc28-42f3-a4ad-0fc1f16a55c4 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-eabf0463-dc28-42f3-a4ad-0fc1f16a55c4 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-eabf0463-dc28-42f3-a4ad-0fc1f16a55c4 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-eabf0463-dc28-42f3-a4ad-0fc1f16a55c4 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-eabf0463-dc28-42f3-a4ad-0fc1f16a55c4 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eabf0463-dc28-42f3-a4ad-0fc1f16a55c4 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:29 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:15:29 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:29 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4" returned: 0 in 0.510s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75559ea4-eff1-4abb-9aa6-d17510c9d891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:15:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.ffcee897-7932-489b-9f50-35be88af4af2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:29 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.ffcee897-7932-489b-9f50-35be88af4af2 Jul 22 12:15:29 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:29 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eabf0463-dc28-42f3-a4ad-0fc1f16a55c4 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.410s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:29 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-eabf0463-dc28-42f3-a4ad-0fc1f16a55c4 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:15:29 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-eabf0463-dc28-42f3-a4ad-0fc1f16a55c4 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Deleted volume successfully. Jul 22 12:15:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-eabf0463-dc28-42f3-a4ad-0fc1f16a55c4 tempest-VolumeRetypeWithoutMigrationTest-52277800 None] Lock "cinder-ff52d4ae-b1af-40b5-a3cc-25a9e5df202a-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:29 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.ffcee897-7932-489b-9f50-35be88af4af2" returned: 0 in 0.561s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.ffcee897-7932-489b-9f50-35be88af4af2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:29 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.ffcee897-7932-489b-9f50-35be88af4af2 Jul 22 12:15:29 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:30 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.ffcee897-7932-489b-9f50-35be88af4af2" returned: 0 in 0.326s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-quobyte-ffcee897-7932-489b-9f50-35be88af4af2" released by "_delete_snapshot" :: held 2.016s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-quobyte-75559ea4-eff1-4abb-9aa6-d17510c9d891" released by "delete_snapshot" :: held 2.044s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:30 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] Created reservations ['a693a6f8-4e76-4380-97ca-61f7d182a8ce', '53d71edd-84d3-4e35-a782-5e3fe0d2c545', 'cd96cb9b-ac24-4ed8-90d4-12bd1f926deb', 'd1fe8856-d9ef-408b-945a-f3fee6df7d2a'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:30 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] Delete snapshot completed successfully. Jul 22 12:15:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-417f024e-a418-4b3b-ae9c-c066508189e8 tempest-SnapshotsActionsTest-1182305158 None] Lock "cinder-ffcee897-7932-489b-9f50-35be88af4af2-delete_snapshot" released by "delete_snapshot" :: held 2.198s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-61c0c737-370f-4ae3-8c26-04ecdfac4a45 tempest-SnapshotsActionsTest-1286604923 None] Acquiring lock "cinder-0c753739-09d9-441f-8d75-46d2c7fac5c4-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-61c0c737-370f-4ae3-8c26-04ecdfac4a45 tempest-SnapshotsActionsTest-1286604923 None] Lock "cinder-0c753739-09d9-441f-8d75-46d2c7fac5c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-61c0c737-370f-4ae3-8c26-04ecdfac4a45 tempest-SnapshotsActionsTest-1286604923 None] Acquiring lock "cinder-quobyte-75559ea4-eff1-4abb-9aa6-d17510c9d891" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-61c0c737-370f-4ae3-8c26-04ecdfac4a45 tempest-SnapshotsActionsTest-1286604923 None] Lock "cinder-quobyte-75559ea4-eff1-4abb-9aa6-d17510c9d891" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-61c0c737-370f-4ae3-8c26-04ecdfac4a45 tempest-SnapshotsActionsTest-1286604923 None] Acquiring lock "cinder-quobyte-0c753739-09d9-441f-8d75-46d2c7fac5c4" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-61c0c737-370f-4ae3-8c26-04ecdfac4a45 tempest-SnapshotsActionsTest-1286604923 None] Lock "cinder-quobyte-0c753739-09d9-441f-8d75-46d2c7fac5c4" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-61c0c737-370f-4ae3-8c26-04ecdfac4a45 tempest-SnapshotsActionsTest-1286604923 None] Deleting offline snapshot 0c753739-09d9-441f-8d75-46d2c7fac5c4 of volume 75559ea4-eff1-4abb-9aa6-d17510c9d891 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-61c0c737-370f-4ae3-8c26-04ecdfac4a45 tempest-SnapshotsActionsTest-1286604923 None] snapshot_file for this snap is: volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc367ec3-85fa-4e11-b578-c6c55c192d2f]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-61c0c737-370f-4ae3-8c26-04ecdfac4a45 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:32 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 Jul 22 12:15:32 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:32 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-61c0c737-370f-4ae3-8c26-04ecdfac4a45 tempest-SnapshotsActionsTest-1286604923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4" returned: 0 in 0.511s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-61c0c737-370f-4ae3-8c26-04ecdfac4a45 tempest-SnapshotsActionsTest-1286604923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75559ea4-eff1-4abb-9aa6-d17510c9d891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Flow 'volume_create_manager' (a707dde1-2002-477b-a024-0ea46ea7ac40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e34610-48c3-4e52-a602-1830491431c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdbdf32-ab62-4ae0-97cc-1e69e1b592bb]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-61c0c737-370f-4ae3-8c26-04ecdfac4a45 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e34610-48c3-4e52-a602-1830491431c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-632958130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6af5295-f81e-446a-a57b-41768f3b1dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6ec7ba93284610a036c0df551ad0ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:15:32Z,use_quota=True,user_id='58c0da32a88e4421983225ada8748fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b22186-1a9c-430b-bfc7-1f8723fc01e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b22186-1a9c-430b-bfc7-1f8723fc01e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c70adccf-6cbc-41f9-8e6d-ddcecee6a527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c70adccf-6cbc-41f9-8e6d-ddcecee6a527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6af5295-f81e-446a-a57b-41768f3b1dbb', 'volume_name': 'volume-f6af5295-f81e-446a-a57b-41768f3b1dbb', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (218e3728-f6bc-48d4-a15e-47ec7dfe4815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (218e3728-f6bc-48d4-a15e-47ec7dfe4815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd8e0ff-6994-4ff4-b87b-54a47b1a4951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:32 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Volume f6af5295-f81e-446a-a57b-41768f3b1dbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6af5295-f81e-446a-a57b-41768f3b1dbb', 'volume_size': 1} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-632958130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6af5295-f81e-446a-a57b-41768f3b1dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6ec7ba93284610a036c0df551ad0ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:15:32Z,use_quota=True,user_id='58c0da32a88e4421983225ada8748fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Creating volume f6af5295-f81e-446a-a57b-41768f3b1dbb {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:15:32 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:15:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:32 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891 Jul 22 12:15:32 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:32 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb 1073741824 Jul 22 12:15:32 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:33 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-61c0c737-370f-4ae3-8c26-04ecdfac4a45 tempest-SnapshotsActionsTest-1286604923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891" returned: 0 in 0.417s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-61c0c737-370f-4ae3-8c26-04ecdfac4a45 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:33 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 Jul 22 12:15:33 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:33 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb 1073741824" returned: 0 in 0.660s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:33 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb Jul 22 12:15:33 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:33 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-61c0c737-370f-4ae3-8c26-04ecdfac4a45 tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4" returned: 0 in 0.443s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-61c0c737-370f-4ae3-8c26-04ecdfac4a45 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:33 devstack sudo[95966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4 Jul 22 12:15:33 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:33 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb" returned: 0 in 0.287s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:15:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd8e0ff-6994-4ff4-b87b-54a47b1a4951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6af5295-f81e-446a-a57b-41768f3b1dbb', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337980b3-b59b-4469-938f-c493b19a97b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:33 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Volume volume-f6af5295-f81e-446a-a57b-41768f3b1dbb (f6af5295-f81e-446a-a57b-41768f3b1dbb): created successfully Jul 22 12:15:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337980b3-b59b-4469-938f-c493b19a97b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Flow 'volume_create_manager' (a707dde1-2002-477b-a024-0ea46ea7ac40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:33 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b3f6911d-1de7-417a-9126-b5251130a50f tempest-SnapshotMetadataTestJSON-613372391 None] Created volume successfully. Jul 22 12:15:33 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-61c0c737-370f-4ae3-8c26-04ecdfac4a45 tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891.0c753739-09d9-441f-8d75-46d2c7fac5c4" returned: 0 in 0.322s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-61c0c737-370f-4ae3-8c26-04ecdfac4a45 tempest-SnapshotsActionsTest-1286604923 None] Lock "cinder-quobyte-0c753739-09d9-441f-8d75-46d2c7fac5c4" released by "_delete_snapshot" :: held 1.894s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-61c0c737-370f-4ae3-8c26-04ecdfac4a45 tempest-SnapshotsActionsTest-1286604923 None] Lock "cinder-quobyte-75559ea4-eff1-4abb-9aa6-d17510c9d891" released by "delete_snapshot" :: held 1.929s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:33 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-61c0c737-370f-4ae3-8c26-04ecdfac4a45 tempest-SnapshotsActionsTest-1286604923 None] Created reservations ['81b6f836-082b-4a31-9f16-9683776cabf8', '19132101-118f-4feb-adfa-1b4b430288ce', '92508453-1343-4deb-972f-4e6462d38f49', 'b8d8b4e8-a633-4a8b-b0b7-f1c10d678ffb'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:34 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-61c0c737-370f-4ae3-8c26-04ecdfac4a45 tempest-SnapshotsActionsTest-1286604923 None] Delete snapshot completed successfully. Jul 22 12:15:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-61c0c737-370f-4ae3-8c26-04ecdfac4a45 tempest-SnapshotsActionsTest-1286604923 None] Lock "cinder-0c753739-09d9-441f-8d75-46d2c7fac5c4-delete_snapshot" released by "delete_snapshot" :: held 2.096s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-70684458-28c8-426f-b95a-d44220c15c52 tempest-SnapshotsActionsTest-1286604923 None] Acquiring lock "cinder-75559ea4-eff1-4abb-9aa6-d17510c9d891-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-70684458-28c8-426f-b95a-d44220c15c52 tempest-SnapshotsActionsTest-1286604923 None] Lock "cinder-75559ea4-eff1-4abb-9aa6-d17510c9d891-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-70684458-28c8-426f-b95a-d44220c15c52 tempest-SnapshotsActionsTest-1286604923 None] Acquiring lock "cinder-quobyte-75559ea4-eff1-4abb-9aa6-d17510c9d891" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-70684458-28c8-426f-b95a-d44220c15c52 tempest-SnapshotsActionsTest-1286604923 None] Lock "cinder-quobyte-75559ea4-eff1-4abb-9aa6-d17510c9d891" acquired by "delete_volume" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:34 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[db45cc01-72b8-47ef-8440-469e989f79fc]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-70684458-28c8-426f-b95a-d44220c15c52 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:34 devstack sudo[95970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891 Jul 22 12:15:34 devstack sudo[95970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:34 devstack sudo[95970]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-70684458-28c8-426f-b95a-d44220c15c52 tempest-SnapshotsActionsTest-1286604923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891" returned: 0 in 0.452s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-70684458-28c8-426f-b95a-d44220c15c52 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:34 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891 Jul 22 12:15:34 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-59ed2219-168e-44be-86a8-b03a68249c44 tempest-SnapshotMetadataTestJSON-613372391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-59ed2219-168e-44be-86a8-b03a68249c44 tempest-SnapshotMetadataTestJSON-613372391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-59ed2219-168e-44be-86a8-b03a68249c44 tempest-SnapshotMetadataTestJSON-613372391 None] Creating offline snapshot c9b3dc4c-9ea4-4749-aa72-ab177f460628 of volume f6af5295-f81e-446a-a57b-41768f3b1dbb {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:15:34 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cdb76e-c656-452d-8ba4-3d890d414cbf]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-59ed2219-168e-44be-86a8-b03a68249c44 tempest-SnapshotMetadataTestJSON-613372391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:35 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb Jul 22 12:15:35 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:35 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-70684458-28c8-426f-b95a-d44220c15c52 tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-75559ea4-eff1-4abb-9aa6-d17510c9d891" returned: 0 in 0.329s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-70684458-28c8-426f-b95a-d44220c15c52 tempest-SnapshotsActionsTest-1286604923 None] Lock "cinder-quobyte-75559ea4-eff1-4abb-9aa6-d17510c9d891" released by "delete_volume" :: held 0.854s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:35 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-70684458-28c8-426f-b95a-d44220c15c52 tempest-SnapshotsActionsTest-1286604923 None] Created reservations ['0c3a2ee1-3d02-40ec-b3fc-4c46a813aead', '699cb2a8-1c4f-4459-964b-57004abacf36', 'bf7377e9-7745-4bfd-bd3e-be536cdb1ca2', 'c220d450-70ed-4e9c-aa12-b295c5743578'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-70684458-28c8-426f-b95a-d44220c15c52 tempest-SnapshotsActionsTest-1286604923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-70684458-28c8-426f-b95a-d44220c15c52 tempest-SnapshotsActionsTest-1286604923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-70684458-28c8-426f-b95a-d44220c15c52 tempest-SnapshotsActionsTest-1286604923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-70684458-28c8-426f-b95a-d44220c15c52 tempest-SnapshotsActionsTest-1286604923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-70684458-28c8-426f-b95a-d44220c15c52 tempest-SnapshotsActionsTest-1286604923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-70684458-28c8-426f-b95a-d44220c15c52 tempest-SnapshotsActionsTest-1286604923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:35 devstack sudo[95988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:15:35 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:35 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-59ed2219-168e-44be-86a8-b03a68249c44 tempest-SnapshotMetadataTestJSON-613372391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb" returned: 0 in 0.483s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-59ed2219-168e-44be-86a8-b03a68249c44 tempest-SnapshotMetadataTestJSON-613372391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.c9b3dc4c-9ea4-4749-aa72-ab177f460628 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:35 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.c9b3dc4c-9ea4-4749-aa72-ab177f460628 1G Jul 22 12:15:35 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:35 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-70684458-28c8-426f-b95a-d44220c15c52 tempest-SnapshotsActionsTest-1286604923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.327s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:35 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-70684458-28c8-426f-b95a-d44220c15c52 tempest-SnapshotsActionsTest-1286604923 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:15:35 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-70684458-28c8-426f-b95a-d44220c15c52 tempest-SnapshotsActionsTest-1286604923 None] Deleted volume successfully. Jul 22 12:15:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-70684458-28c8-426f-b95a-d44220c15c52 tempest-SnapshotsActionsTest-1286604923 None] Lock "cinder-75559ea4-eff1-4abb-9aa6-d17510c9d891-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:35 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-59ed2219-168e-44be-86a8-b03a68249c44 tempest-SnapshotMetadataTestJSON-613372391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.c9b3dc4c-9ea4-4749-aa72-ab177f460628 1G" returned: 0 in 0.535s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-59ed2219-168e-44be-86a8-b03a68249c44 tempest-SnapshotMetadataTestJSON-613372391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6af5295-f81e-446a-a57b-41768f3b1dbb -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.c9b3dc4c-9ea4-4749-aa72-ab177f460628 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:35 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6af5295-f81e-446a-a57b-41768f3b1dbb -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.c9b3dc4c-9ea4-4749-aa72-ab177f460628 Jul 22 12:15:35 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:36 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-59ed2219-168e-44be-86a8-b03a68249c44 tempest-SnapshotMetadataTestJSON-613372391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6af5295-f81e-446a-a57b-41768f3b1dbb -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.c9b3dc4c-9ea4-4749-aa72-ab177f460628" returned: 0 in 0.362s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:36 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-59ed2219-168e-44be-86a8-b03a68249c44 tempest-SnapshotMetadataTestJSON-613372391 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.c9b3dc4c-9ea4-4749-aa72-ab177f460628 is being set with open permissions: ugo+rw Jul 22 12:15:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-59ed2219-168e-44be-86a8-b03a68249c44 tempest-SnapshotMetadataTestJSON-613372391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.c9b3dc4c-9ea4-4749-aa72-ab177f460628 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:36 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.c9b3dc4c-9ea4-4749-aa72-ab177f460628 Jul 22 12:15:36 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:36 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-59ed2219-168e-44be-86a8-b03a68249c44 tempest-SnapshotMetadataTestJSON-613372391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.c9b3dc4c-9ea4-4749-aa72-ab177f460628" returned: 0 in 0.330s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:36 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:15:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Flow 'volume_create_manager' (92b5eca2-c402-435f-8afd-8aba9ca6860f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c67b5ac5-5f7b-41f8-aa6b-5e319bb2f18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c67b5ac5-5f7b-41f8-aa6b-5e319bb2f18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1375565350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9557fb55-8a45-4c74-8a19-794a60f317aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6755230e6a494887b02f186cfe1c27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:15:37Z,use_quota=True,user_id='f2d333adcb464f328eb19cc4d381e979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56be2cfc-0693-46e9-9842-2b50f962e9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56be2cfc-0693-46e9-9842-2b50f962e9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4014345e-8b8f-4ba6-b560-eb1b929a0f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4014345e-8b8f-4ba6-b560-eb1b929a0f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9557fb55-8a45-4c74-8a19-794a60f317aa', 'volume_name': 'volume-9557fb55-8a45-4c74-8a19-794a60f317aa', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09181985-e605-4a05-823f-83b9dde0b946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09181985-e605-4a05-823f-83b9dde0b946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc329bc3-62dc-4877-8ca4-df554d6ed7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:36 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Volume 9557fb55-8a45-4c74-8a19-794a60f317aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9557fb55-8a45-4c74-8a19-794a60f317aa', 'volume_size': 1} Jul 22 12:15:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-59ed2219-168e-44be-86a8-b03a68249c44 tempest-SnapshotMetadataTestJSON-613372391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:36 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.info Jul 22 12:15:36 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:37 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-59ed2219-168e-44be-86a8-b03a68249c44 tempest-SnapshotMetadataTestJSON-613372391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.info" returned: 0 in 0.324s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:37 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-59ed2219-168e-44be-86a8-b03a68249c44 tempest-SnapshotMetadataTestJSON-613372391 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.info is being set with open permissions: ugo+rw Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-59ed2219-168e-44be-86a8-b03a68249c44 tempest-SnapshotMetadataTestJSON-613372391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:37 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.info Jul 22 12:15:37 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:37 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-59ed2219-168e-44be-86a8-b03a68249c44 tempest-SnapshotMetadataTestJSON-613372391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.info" returned: 0 in 0.281s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-59ed2219-168e-44be-86a8-b03a68249c44 tempest-SnapshotMetadataTestJSON-613372391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.504s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.636s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1375565350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9557fb55-8a45-4c74-8a19-794a60f317aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6755230e6a494887b02f186cfe1c27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:15:37Z,use_quota=True,user_id='f2d333adcb464f328eb19cc4d381e979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Creating volume 9557fb55-8a45-4c74-8a19-794a60f317aa {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:15:37 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9557fb55-8a45-4c74-8a19-794a60f317aa 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:37 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9557fb55-8a45-4c74-8a19-794a60f317aa 1073741824 Jul 22 12:15:37 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:37 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-59ed2219-168e-44be-86a8-b03a68249c44 tempest-SnapshotMetadataTestJSON-613372391 None] Create snapshot completed successfully Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Flow 'volume_create_manager' (144887e4-b066-477a-9ec3-fff2d9362c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e7f7f6e-a3ba-4093-b1f9-a1180fa7a2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e7f7f6e-a3ba-4093-b1f9-a1180fa7a2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-423205091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e49fad4-4cdc-4129-8d2a-d160c440901e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02acb5e01577474b99cbd2d5717af57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:15:38Z,use_quota=True,user_id='cd48888c313e4cdba518157c62ac567a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0c2711-1d77-475d-b86c-759790713a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0c2711-1d77-475d-b86c-759790713a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea293a5-322b-42c3-9924-232236b8f9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea293a5-322b-42c3-9924-232236b8f9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e49fad4-4cdc-4129-8d2a-d160c440901e', 'volume_name': 'volume-0e49fad4-4cdc-4129-8d2a-d160c440901e', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3278d892-517e-4ee8-8434-6442c194fd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3278d892-517e-4ee8-8434-6442c194fd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a6ff36d-127b-48ba-9a11-a277d490b530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:37 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Volume 0e49fad4-4cdc-4129-8d2a-d160c440901e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e49fad4-4cdc-4129-8d2a-d160c440901e', 'volume_size': 1} Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:37 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9557fb55-8a45-4c74-8a19-794a60f317aa 1073741824" returned: 0 in 0.586s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9557fb55-8a45-4c74-8a19-794a60f317aa {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:38 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9557fb55-8a45-4c74-8a19-794a60f317aa Jul 22 12:15:38 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:38 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9557fb55-8a45-4c74-8a19-794a60f317aa" returned: 0 in 0.290s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:15:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.509s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-423205091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e49fad4-4cdc-4129-8d2a-d160c440901e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02acb5e01577474b99cbd2d5717af57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:15:38Z,use_quota=True,user_id='cd48888c313e4cdba518157c62ac567a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:15:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Creating volume 0e49fad4-4cdc-4129-8d2a-d160c440901e {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:15:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:15:38 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:15:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc329bc3-62dc-4877-8ca4-df554d6ed7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9557fb55-8a45-4c74-8a19-794a60f317aa', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2bded75-73d7-4df3-9007-cfa7a09c5855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:38 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e 1073741824 Jul 22 12:15:38 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:38 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Volume volume-9557fb55-8a45-4c74-8a19-794a60f317aa (9557fb55-8a45-4c74-8a19-794a60f317aa): created successfully Jul 22 12:15:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2bded75-73d7-4df3-9007-cfa7a09c5855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Flow 'volume_create_manager' (92b5eca2-c402-435f-8afd-8aba9ca6860f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:38 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-45dd3e3e-331f-4067-a216-7fe7793e478b tempest-VolumesListAdminTestJSON-338408496 None] Created volume successfully. Jul 22 12:15:39 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e 1073741824" returned: 0 in 0.693s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e9dc8fca-0517-4333-9ffc-939de836965b tempest-SnapshotMetadataTestJSON-613372391 None] Acquiring lock "cinder-c9b3dc4c-9ea4-4749-aa72-ab177f460628-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e9dc8fca-0517-4333-9ffc-939de836965b tempest-SnapshotMetadataTestJSON-613372391 None] Lock "cinder-c9b3dc4c-9ea4-4749-aa72-ab177f460628-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e9dc8fca-0517-4333-9ffc-939de836965b tempest-SnapshotMetadataTestJSON-613372391 None] Acquiring lock "cinder-quobyte-f6af5295-f81e-446a-a57b-41768f3b1dbb" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e9dc8fca-0517-4333-9ffc-939de836965b tempest-SnapshotMetadataTestJSON-613372391 None] Lock "cinder-quobyte-f6af5295-f81e-446a-a57b-41768f3b1dbb" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e9dc8fca-0517-4333-9ffc-939de836965b tempest-SnapshotMetadataTestJSON-613372391 None] Acquiring lock "cinder-quobyte-c9b3dc4c-9ea4-4749-aa72-ab177f460628" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:39 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e Jul 22 12:15:39 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e9dc8fca-0517-4333-9ffc-939de836965b tempest-SnapshotMetadataTestJSON-613372391 None] Lock "cinder-quobyte-c9b3dc4c-9ea4-4749-aa72-ab177f460628" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-e9dc8fca-0517-4333-9ffc-939de836965b tempest-SnapshotMetadataTestJSON-613372391 None] Deleting offline snapshot c9b3dc4c-9ea4-4749-aa72-ab177f460628 of volume f6af5295-f81e-446a-a57b-41768f3b1dbb {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-e9dc8fca-0517-4333-9ffc-939de836965b tempest-SnapshotMetadataTestJSON-613372391 None] snapshot_file for this snap is: volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.c9b3dc4c-9ea4-4749-aa72-ab177f460628 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2c16ff-de01-4861-a5e4-5fa62dbd2089]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e9dc8fca-0517-4333-9ffc-939de836965b tempest-SnapshotMetadataTestJSON-613372391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.c9b3dc4c-9ea4-4749-aa72-ab177f460628 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:39 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.c9b3dc4c-9ea4-4749-aa72-ab177f460628 Jul 22 12:15:39 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Flow 'volume_create_manager' (1bcb7b79-7c76-4f64-a5e1-950e0a99f035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57dc46d1-182d-4492-a8f2-99294a16161a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:39 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e" returned: 0 in 0.321s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57dc46d1-182d-4492-a8f2-99294a16161a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-567543511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01bb79fd-0191-44e7-84c1-b2590526e108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6755230e6a494887b02f186cfe1c27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:15:39Z,use_quota=True,user_id='f2d333adcb464f328eb19cc4d381e979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7851dc97-27c3-44f2-9964-6d6006d40266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7851dc97-27c3-44f2-9964-6d6006d40266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cbfc5c-7291-4958-8b80-30271c96fb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cbfc5c-7291-4958-8b80-30271c96fb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01bb79fd-0191-44e7-84c1-b2590526e108', 'volume_name': 'volume-01bb79fd-0191-44e7-84c1-b2590526e108', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3609214c-18f2-4dba-be86-71a85ac20403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3609214c-18f2-4dba-be86-71a85ac20403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb4dfd1-8965-45ac-8551-d13e4e85dfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:39 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Volume 01bb79fd-0191-44e7-84c1-b2590526e108: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01bb79fd-0191-44e7-84c1-b2590526e108', 'volume_size': 1} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-567543511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01bb79fd-0191-44e7-84c1-b2590526e108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6755230e6a494887b02f186cfe1c27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:15:39Z,use_quota=True,user_id='f2d333adcb464f328eb19cc4d381e979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Creating volume 01bb79fd-0191-44e7-84c1-b2590526e108 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:15:39 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-01bb79fd-0191-44e7-84c1-b2590526e108 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a6ff36d-127b-48ba-9a11-a277d490b530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e49fad4-4cdc-4129-8d2a-d160c440901e', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6e064d-552d-43ba-9aa1-08c667e96b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:39 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-01bb79fd-0191-44e7-84c1-b2590526e108 1073741824 Jul 22 12:15:39 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:39 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Volume volume-0e49fad4-4cdc-4129-8d2a-d160c440901e (0e49fad4-4cdc-4129-8d2a-d160c440901e): created successfully Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6e064d-552d-43ba-9aa1-08c667e96b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Flow 'volume_create_manager' (144887e4-b066-477a-9ec3-fff2d9362c7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:39 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-c17339c3-5e73-4784-b477-1b4bcf1a5e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Created volume successfully. Jul 22 12:15:39 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e9dc8fca-0517-4333-9ffc-939de836965b tempest-SnapshotMetadataTestJSON-613372391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.c9b3dc4c-9ea4-4749-aa72-ab177f460628" returned: 0 in 0.430s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-e9dc8fca-0517-4333-9ffc-939de836965b tempest-SnapshotMetadataTestJSON-613372391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6af5295-f81e-446a-a57b-41768f3b1dbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[824fd718-c4a8-4a8c-bd6c-bf5db8623ad9]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e9dc8fca-0517-4333-9ffc-939de836965b tempest-SnapshotMetadataTestJSON-613372391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:39 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb Jul 22 12:15:39 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2f465875-2aee-416a-87d3-faaf4f87725a tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:40 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-01bb79fd-0191-44e7-84c1-b2590526e108 1073741824" returned: 0 in 0.657s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-01bb79fd-0191-44e7-84c1-b2590526e108 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:40 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-01bb79fd-0191-44e7-84c1-b2590526e108 Jul 22 12:15:40 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:40 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e9dc8fca-0517-4333-9ffc-939de836965b tempest-SnapshotMetadataTestJSON-613372391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb" returned: 0 in 0.512s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e9dc8fca-0517-4333-9ffc-939de836965b tempest-SnapshotMetadataTestJSON-613372391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.c9b3dc4c-9ea4-4749-aa72-ab177f460628 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:40 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.c9b3dc4c-9ea4-4749-aa72-ab177f460628 Jul 22 12:15:40 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:40 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-01bb79fd-0191-44e7-84c1-b2590526e108" returned: 0 in 0.281s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:15:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2f465875-2aee-416a-87d3-faaf4f87725a tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.386s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb4dfd1-8965-45ac-8551-d13e4e85dfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01bb79fd-0191-44e7-84c1-b2590526e108', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6e1c48-8216-432f-b9e6-d9dd4c7e19d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-2f465875-2aee-416a-87d3-faaf4f87725a tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Creating offline snapshot ed3a543a-8b62-47a7-8a3c-fd941c54b07f of volume 0e49fad4-4cdc-4129-8d2a-d160c440901e {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:15:40 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Volume volume-01bb79fd-0191-44e7-84c1-b2590526e108 (01bb79fd-0191-44e7-84c1-b2590526e108): created successfully Jul 22 12:15:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6e1c48-8216-432f-b9e6-d9dd4c7e19d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Flow 'volume_create_manager' (1bcb7b79-7c76-4f64-a5e1-950e0a99f035) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:40 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a60543-0c3c-4eec-9a01-2222b15abc46]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2f465875-2aee-416a-87d3-faaf4f87725a tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:40 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-245fe1fd-5cb3-4641-8a3e-997d4c9e8542 tempest-VolumesListAdminTestJSON-338408496 None] Created volume successfully. Jul 22 12:15:40 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e9dc8fca-0517-4333-9ffc-939de836965b tempest-SnapshotMetadataTestJSON-613372391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.c9b3dc4c-9ea4-4749-aa72-ab177f460628" returned: 0 in 0.410s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e9dc8fca-0517-4333-9ffc-939de836965b tempest-SnapshotMetadataTestJSON-613372391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.c9b3dc4c-9ea4-4749-aa72-ab177f460628 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:40 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.c9b3dc4c-9ea4-4749-aa72-ab177f460628 Jul 22 12:15:40 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:40 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e Jul 22 12:15:40 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:40 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e9dc8fca-0517-4333-9ffc-939de836965b tempest-SnapshotMetadataTestJSON-613372391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb.c9b3dc4c-9ea4-4749-aa72-ab177f460628" returned: 0 in 0.316s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:40 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2f465875-2aee-416a-87d3-faaf4f87725a tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e" returned: 0 in 0.426s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2f465875-2aee-416a-87d3-faaf4f87725a tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.ed3a543a-8b62-47a7-8a3c-fd941c54b07f 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:40 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.ed3a543a-8b62-47a7-8a3c-fd941c54b07f 1G Jul 22 12:15:40 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e9dc8fca-0517-4333-9ffc-939de836965b tempest-SnapshotMetadataTestJSON-613372391 None] Lock "cinder-quobyte-c9b3dc4c-9ea4-4749-aa72-ab177f460628" released by "_delete_snapshot" :: held 1.862s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e9dc8fca-0517-4333-9ffc-939de836965b tempest-SnapshotMetadataTestJSON-613372391 None] Lock "cinder-quobyte-f6af5295-f81e-446a-a57b-41768f3b1dbb" released by "delete_snapshot" :: held 1.897s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:41 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-e9dc8fca-0517-4333-9ffc-939de836965b tempest-SnapshotMetadataTestJSON-613372391 None] Created reservations ['12cf6a5b-793c-4994-8545-5ac0246ae271', 'fcefdd80-82b6-4e0d-9c7e-26c224a6a82c', 'b029d7a2-0809-4f66-8e77-aa53164e231a', 'ebc9bdd8-0b1b-4c45-bc4a-bdaab9bb178c'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:41 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e9dc8fca-0517-4333-9ffc-939de836965b tempest-SnapshotMetadataTestJSON-613372391 None] Delete snapshot completed successfully. Jul 22 12:15:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e9dc8fca-0517-4333-9ffc-939de836965b tempest-SnapshotMetadataTestJSON-613372391 None] Lock "cinder-c9b3dc4c-9ea4-4749-aa72-ab177f460628-delete_snapshot" released by "delete_snapshot" :: held 2.112s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b1061248-5226-4a98-9966-244d29a69b7a tempest-SnapshotMetadataTestJSON-613372391 None] Acquiring lock "cinder-f6af5295-f81e-446a-a57b-41768f3b1dbb-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b1061248-5226-4a98-9966-244d29a69b7a tempest-SnapshotMetadataTestJSON-613372391 None] Lock "cinder-f6af5295-f81e-446a-a57b-41768f3b1dbb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b1061248-5226-4a98-9966-244d29a69b7a tempest-SnapshotMetadataTestJSON-613372391 None] Acquiring lock "cinder-quobyte-f6af5295-f81e-446a-a57b-41768f3b1dbb" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b1061248-5226-4a98-9966-244d29a69b7a tempest-SnapshotMetadataTestJSON-613372391 None] Lock "cinder-quobyte-f6af5295-f81e-446a-a57b-41768f3b1dbb" acquired by "delete_volume" :: waited 0.021s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:41 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[478814fb-4ef0-40d0-947a-f81b1c350978]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b1061248-5226-4a98-9966-244d29a69b7a tempest-SnapshotMetadataTestJSON-613372391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:41 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2f465875-2aee-416a-87d3-faaf4f87725a tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.ed3a543a-8b62-47a7-8a3c-fd941c54b07f 1G" returned: 0 in 0.534s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2f465875-2aee-416a-87d3-faaf4f87725a tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e49fad4-4cdc-4129-8d2a-d160c440901e -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.ed3a543a-8b62-47a7-8a3c-fd941c54b07f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:41 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e49fad4-4cdc-4129-8d2a-d160c440901e -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.ed3a543a-8b62-47a7-8a3c-fd941c54b07f Jul 22 12:15:41 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:41 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb Jul 22 12:15:41 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:41 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b1061248-5226-4a98-9966-244d29a69b7a tempest-SnapshotMetadataTestJSON-613372391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb" returned: 0 in 0.416s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b1061248-5226-4a98-9966-244d29a69b7a tempest-SnapshotMetadataTestJSON-613372391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:41 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2f465875-2aee-416a-87d3-faaf4f87725a tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e49fad4-4cdc-4129-8d2a-d160c440901e -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.ed3a543a-8b62-47a7-8a3c-fd941c54b07f" returned: 0 in 0.417s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:41 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-2f465875-2aee-416a-87d3-faaf4f87725a tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.ed3a543a-8b62-47a7-8a3c-fd941c54b07f is being set with open permissions: ugo+rw Jul 22 12:15:41 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb Jul 22 12:15:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2f465875-2aee-416a-87d3-faaf4f87725a tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.ed3a543a-8b62-47a7-8a3c-fd941c54b07f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:41 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:41 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.ed3a543a-8b62-47a7-8a3c-fd941c54b07f Jul 22 12:15:41 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Flow 'volume_create_manager' (cc7fee41-04d2-4fbe-9115-98604d180988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:42 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:42 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c42b911-be3b-4495-ada5-9faf12fe6a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b1061248-5226-4a98-9966-244d29a69b7a tempest-SnapshotMetadataTestJSON-613372391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f6af5295-f81e-446a-a57b-41768f3b1dbb" returned: 0 in 0.400s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2f465875-2aee-416a-87d3-faaf4f87725a tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.ed3a543a-8b62-47a7-8a3c-fd941c54b07f" returned: 0 in 0.363s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b1061248-5226-4a98-9966-244d29a69b7a tempest-SnapshotMetadataTestJSON-613372391 None] Lock "cinder-quobyte-f6af5295-f81e-446a-a57b-41768f3b1dbb" released by "delete_volume" :: held 0.900s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c42b911-be3b-4495-ada5-9faf12fe6a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-471524626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7d55675-7552-4bc3-a120-22bac930dcff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6755230e6a494887b02f186cfe1c27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:15:42Z,use_quota=True,user_id='f2d333adcb464f328eb19cc4d381e979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75470a12-efc8-4dba-b1ad-fc36a0404c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75470a12-efc8-4dba-b1ad-fc36a0404c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5fb765d-b529-4e6d-be7d-60dc2a3a0a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5fb765d-b529-4e6d-be7d-60dc2a3a0a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7d55675-7552-4bc3-a120-22bac930dcff', 'volume_name': 'volume-a7d55675-7552-4bc3-a120-22bac930dcff', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d015a9f-5723-45f2-b40f-53c4788564ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d015a9f-5723-45f2-b40f-53c4788564ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d61c87e-9695-4545-8a68-973d8f42bda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:42 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Volume a7d55675-7552-4bc3-a120-22bac930dcff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7d55675-7552-4bc3-a120-22bac930dcff', 'volume_size': 1} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2f465875-2aee-416a-87d3-faaf4f87725a tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:42 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.info Jul 22 12:15:42 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-b1061248-5226-4a98-9966-244d29a69b7a tempest-SnapshotMetadataTestJSON-613372391 None] Created reservations ['c43cc0b2-f08b-4756-9d9d-20038f9a4936', 'b9cd3682-1abd-443f-94fd-904e3e267a7a', '288687e3-7c0d-4bb0-b069-e323dabfa5de', '52edd056-8182-4da1-a158-35fdbdca0ee0'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b1061248-5226-4a98-9966-244d29a69b7a tempest-SnapshotMetadataTestJSON-613372391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b1061248-5226-4a98-9966-244d29a69b7a tempest-SnapshotMetadataTestJSON-613372391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b1061248-5226-4a98-9966-244d29a69b7a tempest-SnapshotMetadataTestJSON-613372391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b1061248-5226-4a98-9966-244d29a69b7a tempest-SnapshotMetadataTestJSON-613372391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b1061248-5226-4a98-9966-244d29a69b7a tempest-SnapshotMetadataTestJSON-613372391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b1061248-5226-4a98-9966-244d29a69b7a tempest-SnapshotMetadataTestJSON-613372391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:42 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:15:42 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:42 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2f465875-2aee-416a-87d3-faaf4f87725a tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.info" returned: 0 in 0.277s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:42 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-2f465875-2aee-416a-87d3-faaf4f87725a tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.info is being set with open permissions: ugo+rw Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2f465875-2aee-416a-87d3-faaf4f87725a tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:42 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.info Jul 22 12:15:42 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:42 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b1061248-5226-4a98-9966-244d29a69b7a tempest-SnapshotMetadataTestJSON-613372391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.268s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-b1061248-5226-4a98-9966-244d29a69b7a tempest-SnapshotMetadataTestJSON-613372391 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:15:42 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b1061248-5226-4a98-9966-244d29a69b7a tempest-SnapshotMetadataTestJSON-613372391 None] Deleted volume successfully. Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b1061248-5226-4a98-9966-244d29a69b7a tempest-SnapshotMetadataTestJSON-613372391 None] Lock "cinder-f6af5295-f81e-446a-a57b-41768f3b1dbb-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:42 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2f465875-2aee-416a-87d3-faaf4f87725a tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.info" returned: 0 in 0.265s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2f465875-2aee-416a-87d3-faaf4f87725a tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.475s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.596s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-471524626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7d55675-7552-4bc3-a120-22bac930dcff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6755230e6a494887b02f186cfe1c27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:15:42Z,use_quota=True,user_id='f2d333adcb464f328eb19cc4d381e979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Creating volume a7d55675-7552-4bc3-a120-22bac930dcff {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:15:42 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:15:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7d55675-7552-4bc3-a120-22bac930dcff 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:42 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7d55675-7552-4bc3-a120-22bac930dcff 1073741824 Jul 22 12:15:42 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:42 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-2f465875-2aee-416a-87d3-faaf4f87725a tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Create snapshot completed successfully Jul 22 12:15:43 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7d55675-7552-4bc3-a120-22bac930dcff 1073741824" returned: 0 in 0.608s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7d55675-7552-4bc3-a120-22bac930dcff {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:43 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7d55675-7552-4bc3-a120-22bac930dcff Jul 22 12:15:43 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:43 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7d55675-7552-4bc3-a120-22bac930dcff" returned: 0 in 0.314s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:43 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:15:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d61c87e-9695-4545-8a68-973d8f42bda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7d55675-7552-4bc3-a120-22bac930dcff', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c45a0a-8c4b-46f7-9b8c-e4125e176b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:43 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9fa52e20-e3ad-4a7c-80c2-99b825d65678 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Acquiring lock "cinder-ed3a543a-8b62-47a7-8a3c-fd941c54b07f-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:43 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Volume volume-a7d55675-7552-4bc3-a120-22bac930dcff (a7d55675-7552-4bc3-a120-22bac930dcff): created successfully Jul 22 12:15:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c45a0a-8c4b-46f7-9b8c-e4125e176b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:44 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Flow 'volume_create_manager' (cc7fee41-04d2-4fbe-9115-98604d180988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:44 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9fa52e20-e3ad-4a7c-80c2-99b825d65678 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Lock "cinder-ed3a543a-8b62-47a7-8a3c-fd941c54b07f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:44 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9fa52e20-e3ad-4a7c-80c2-99b825d65678 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Acquiring lock "cinder-quobyte-0e49fad4-4cdc-4129-8d2a-d160c440901e" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:44 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-55821b66-53a0-4fec-9c9b-d7e5de4fca63 tempest-VolumesListAdminTestJSON-338408496 None] Created volume successfully. Jul 22 12:15:44 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9fa52e20-e3ad-4a7c-80c2-99b825d65678 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Lock "cinder-quobyte-0e49fad4-4cdc-4129-8d2a-d160c440901e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:44 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9fa52e20-e3ad-4a7c-80c2-99b825d65678 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Acquiring lock "cinder-quobyte-ed3a543a-8b62-47a7-8a3c-fd941c54b07f" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:44 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9fa52e20-e3ad-4a7c-80c2-99b825d65678 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Lock "cinder-quobyte-ed3a543a-8b62-47a7-8a3c-fd941c54b07f" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:44 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-9fa52e20-e3ad-4a7c-80c2-99b825d65678 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Deleting offline snapshot ed3a543a-8b62-47a7-8a3c-fd941c54b07f of volume 0e49fad4-4cdc-4129-8d2a-d160c440901e {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:15:44 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-9fa52e20-e3ad-4a7c-80c2-99b825d65678 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] snapshot_file for this snap is: volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.ed3a543a-8b62-47a7-8a3c-fd941c54b07f {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:15:44 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c97979-aead-4719-8147-2e7098c381a8]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9fa52e20-e3ad-4a7c-80c2-99b825d65678 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.ed3a543a-8b62-47a7-8a3c-fd941c54b07f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:44 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.ed3a543a-8b62-47a7-8a3c-fd941c54b07f Jul 22 12:15:44 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:44 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9fa52e20-e3ad-4a7c-80c2-99b825d65678 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.ed3a543a-8b62-47a7-8a3c-fd941c54b07f" returned: 0 in 0.553s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:44 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-9fa52e20-e3ad-4a7c-80c2-99b825d65678 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e49fad4-4cdc-4129-8d2a-d160c440901e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:15:44 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3a0481-0396-4238-bbac-05cf76687cd8]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9fa52e20-e3ad-4a7c-80c2-99b825d65678 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:44 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e Jul 22 12:15:44 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:45 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9fa52e20-e3ad-4a7c-80c2-99b825d65678 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e" returned: 0 in 0.492s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9fa52e20-e3ad-4a7c-80c2-99b825d65678 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.ed3a543a-8b62-47a7-8a3c-fd941c54b07f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:45 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.ed3a543a-8b62-47a7-8a3c-fd941c54b07f Jul 22 12:15:45 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Flow 'volume_create_manager' (7da3cb15-eeaa-4708-bbc8-9f0df2a906ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d7778a-6de0-441c-8c55-c6c94a04a84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d7778a-6de0-441c-8c55-c6c94a04a84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d68e0f69-e53f-42ca-9929-39af1cc7a26f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a01d3728b30404aa4f88f47c557ed3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:15:45Z,use_quota=True,user_id='00cadc89cab24ac1a8bd843bda1f208a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747f6159-cd11-41b9-a308-ea4b72c3a1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747f6159-cd11-41b9-a308-ea4b72c3a1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59400d91-d4a6-4831-b7ef-5f1dac2a3a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59400d91-d4a6-4831-b7ef-5f1dac2a3a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd68e0f69-e53f-42ca-9929-39af1cc7a26f', 'volume_name': 'volume-d68e0f69-e53f-42ca-9929-39af1cc7a26f', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b2d435-f9df-47e6-a32b-ea5d43846ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b2d435-f9df-47e6-a32b-ea5d43846ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e209592-f28a-41a3-a39d-7e4974f99d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:45 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Volume d68e0f69-e53f-42ca-9929-39af1cc7a26f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d68e0f69-e53f-42ca-9929-39af1cc7a26f', 'volume_size': 1} Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d68e0f69-e53f-42ca-9929-39af1cc7a26f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a01d3728b30404aa4f88f47c557ed3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:15:45Z,use_quota=True,user_id='00cadc89cab24ac1a8bd843bda1f208a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Creating volume d68e0f69-e53f-42ca-9929-39af1cc7a26f {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:15:45 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d68e0f69-e53f-42ca-9929-39af1cc7a26f 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:45 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d68e0f69-e53f-42ca-9929-39af1cc7a26f 1073741824 Jul 22 12:15:45 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:45 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9fa52e20-e3ad-4a7c-80c2-99b825d65678 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.ed3a543a-8b62-47a7-8a3c-fd941c54b07f" returned: 0 in 0.446s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9fa52e20-e3ad-4a7c-80c2-99b825d65678 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.ed3a543a-8b62-47a7-8a3c-fd941c54b07f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:45 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.ed3a543a-8b62-47a7-8a3c-fd941c54b07f Jul 22 12:15:45 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:46 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d68e0f69-e53f-42ca-9929-39af1cc7a26f 1073741824" returned: 0 in 0.600s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:46 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9fa52e20-e3ad-4a7c-80c2-99b825d65678 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e.ed3a543a-8b62-47a7-8a3c-fd941c54b07f" returned: 0 in 0.341s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d68e0f69-e53f-42ca-9929-39af1cc7a26f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:46 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9fa52e20-e3ad-4a7c-80c2-99b825d65678 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Lock "cinder-quobyte-ed3a543a-8b62-47a7-8a3c-fd941c54b07f" released by "_delete_snapshot" :: held 2.046s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:46 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9fa52e20-e3ad-4a7c-80c2-99b825d65678 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Lock "cinder-quobyte-0e49fad4-4cdc-4129-8d2a-d160c440901e" released by "delete_snapshot" :: held 2.102s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:46 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d68e0f69-e53f-42ca-9929-39af1cc7a26f Jul 22 12:15:46 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:46 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-9fa52e20-e3ad-4a7c-80c2-99b825d65678 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Created reservations ['b0632e6b-cbba-46f6-873a-4eba943c4b0d', '6dd93dd5-fadb-4be0-b36d-644a403de300', '9819c188-c354-4047-a1af-c23cd81f1d46', 'a8eab714-2071-4980-a0b6-38f762772ca6'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:46 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-9fa52e20-e3ad-4a7c-80c2-99b825d65678 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Delete snapshot completed successfully. Jul 22 12:15:46 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9fa52e20-e3ad-4a7c-80c2-99b825d65678 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Lock "cinder-ed3a543a-8b62-47a7-8a3c-fd941c54b07f-delete_snapshot" released by "delete_snapshot" :: held 2.293s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:46 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d68e0f69-e53f-42ca-9929-39af1cc7a26f" returned: 0 in 0.368s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:46 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:15:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:46 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e209592-f28a-41a3-a39d-7e4974f99d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d68e0f69-e53f-42ca-9929-39af1cc7a26f', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:46 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6fd2dc-0815-4db3-93f0-3b8e04b1578e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:46 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Volume volume-d68e0f69-e53f-42ca-9929-39af1cc7a26f (d68e0f69-e53f-42ca-9929-39af1cc7a26f): created successfully Jul 22 12:15:46 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6fd2dc-0815-4db3-93f0-3b8e04b1578e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:46 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Flow 'volume_create_manager' (7da3cb15-eeaa-4708-bbc8-9f0df2a906ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:46 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-df7d50f1-58b6-489d-8166-f0b19196154f tempest-VolumesListAdminTestJSON-706827828 None] Created volume successfully. Jul 22 12:15:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b5f55a9c-150c-4a51-aaf0-b77d3eabcf13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Acquiring lock "cinder-0e49fad4-4cdc-4129-8d2a-d160c440901e-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b5f55a9c-150c-4a51-aaf0-b77d3eabcf13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Lock "cinder-0e49fad4-4cdc-4129-8d2a-d160c440901e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b5f55a9c-150c-4a51-aaf0-b77d3eabcf13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Acquiring lock "cinder-quobyte-0e49fad4-4cdc-4129-8d2a-d160c440901e" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b5f55a9c-150c-4a51-aaf0-b77d3eabcf13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Lock "cinder-quobyte-0e49fad4-4cdc-4129-8d2a-d160c440901e" acquired by "delete_volume" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:47 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[21145242-3195-438d-b648-99450714afa6]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b5f55a9c-150c-4a51-aaf0-b77d3eabcf13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:47 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e Jul 22 12:15:47 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0725af9c-c246-4685-9419-3484ea1342d4 tempest-VolumesListAdminTestJSON-706827828 None] Acquiring lock "cinder-d68e0f69-e53f-42ca-9929-39af1cc7a26f-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0725af9c-c246-4685-9419-3484ea1342d4 tempest-VolumesListAdminTestJSON-706827828 None] Lock "cinder-d68e0f69-e53f-42ca-9929-39af1cc7a26f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0725af9c-c246-4685-9419-3484ea1342d4 tempest-VolumesListAdminTestJSON-706827828 None] Acquiring lock "cinder-quobyte-d68e0f69-e53f-42ca-9929-39af1cc7a26f" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0725af9c-c246-4685-9419-3484ea1342d4 tempest-VolumesListAdminTestJSON-706827828 None] Lock "cinder-quobyte-d68e0f69-e53f-42ca-9929-39af1cc7a26f" acquired by "delete_volume" :: waited 0.029s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:47 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[34116f35-1728-4260-aa14-9e2ec420f1cb]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0725af9c-c246-4685-9419-3484ea1342d4 tempest-VolumesListAdminTestJSON-706827828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d68e0f69-e53f-42ca-9929-39af1cc7a26f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-416c8374-1ab8-45f4-a6fe-ce91cf4bae9a tempest-VolumesListAdminTestJSON-338408496 None] Acquiring lock "cinder-a7d55675-7552-4bc3-a120-22bac930dcff-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-416c8374-1ab8-45f4-a6fe-ce91cf4bae9a tempest-VolumesListAdminTestJSON-338408496 None] Lock "cinder-a7d55675-7552-4bc3-a120-22bac930dcff-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-416c8374-1ab8-45f4-a6fe-ce91cf4bae9a tempest-VolumesListAdminTestJSON-338408496 None] Acquiring lock "cinder-quobyte-a7d55675-7552-4bc3-a120-22bac930dcff" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-416c8374-1ab8-45f4-a6fe-ce91cf4bae9a tempest-VolumesListAdminTestJSON-338408496 None] Lock "cinder-quobyte-a7d55675-7552-4bc3-a120-22bac930dcff" acquired by "delete_volume" :: waited 0.021s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:48 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d68e0f69-e53f-42ca-9929-39af1cc7a26f Jul 22 12:15:48 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:48 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f800049b-e55e-43e4-9b5a-e2562a343229]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-416c8374-1ab8-45f4-a6fe-ce91cf4bae9a tempest-VolumesListAdminTestJSON-338408496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7d55675-7552-4bc3-a120-22bac930dcff {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:48 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b5f55a9c-150c-4a51-aaf0-b77d3eabcf13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e" returned: 0 in 0.666s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b5f55a9c-150c-4a51-aaf0-b77d3eabcf13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:48 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e Jul 22 12:15:48 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:48 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7d55675-7552-4bc3-a120-22bac930dcff Jul 22 12:15:48 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:48 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0725af9c-c246-4685-9419-3484ea1342d4 tempest-VolumesListAdminTestJSON-706827828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d68e0f69-e53f-42ca-9929-39af1cc7a26f" returned: 0 in 0.570s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0725af9c-c246-4685-9419-3484ea1342d4 tempest-VolumesListAdminTestJSON-706827828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d68e0f69-e53f-42ca-9929-39af1cc7a26f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:48 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d68e0f69-e53f-42ca-9929-39af1cc7a26f Jul 22 12:15:48 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:48 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b5f55a9c-150c-4a51-aaf0-b77d3eabcf13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0e49fad4-4cdc-4129-8d2a-d160c440901e" returned: 0 in 0.433s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b5f55a9c-150c-4a51-aaf0-b77d3eabcf13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Lock "cinder-quobyte-0e49fad4-4cdc-4129-8d2a-d160c440901e" released by "delete_volume" :: held 1.188s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:48 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-416c8374-1ab8-45f4-a6fe-ce91cf4bae9a tempest-VolumesListAdminTestJSON-338408496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7d55675-7552-4bc3-a120-22bac930dcff" returned: 0 in 0.614s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-416c8374-1ab8-45f4-a6fe-ce91cf4bae9a tempest-VolumesListAdminTestJSON-338408496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7d55675-7552-4bc3-a120-22bac930dcff {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:48 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7d55675-7552-4bc3-a120-22bac930dcff Jul 22 12:15:48 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-b5f55a9c-150c-4a51-aaf0-b77d3eabcf13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Created reservations ['85337444-3aa9-4818-9cc8-fe135b6d66c5', '0a093c39-ae34-4042-bb6d-05f1cf3703f1', '220e8896-b34e-4281-92ce-464c571c88ac', '76a6fe1b-1853-44a4-aced-679fcf30644b'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:48 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:48 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0725af9c-c246-4685-9419-3484ea1342d4 tempest-VolumesListAdminTestJSON-706827828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d68e0f69-e53f-42ca-9929-39af1cc7a26f" returned: 0 in 0.397s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0725af9c-c246-4685-9419-3484ea1342d4 tempest-VolumesListAdminTestJSON-706827828 None] Lock "cinder-quobyte-d68e0f69-e53f-42ca-9929-39af1cc7a26f" released by "delete_volume" :: held 1.048s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b5f55a9c-150c-4a51-aaf0-b77d3eabcf13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b5f55a9c-150c-4a51-aaf0-b77d3eabcf13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b5f55a9c-150c-4a51-aaf0-b77d3eabcf13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b5f55a9c-150c-4a51-aaf0-b77d3eabcf13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b5f55a9c-150c-4a51-aaf0-b77d3eabcf13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b5f55a9c-150c-4a51-aaf0-b77d3eabcf13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:48 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:15:48 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-0725af9c-c246-4685-9419-3484ea1342d4 tempest-VolumesListAdminTestJSON-706827828 None] Created reservations ['3c9de4cf-887d-4eb8-9678-8c97dc052100', '0e7fd1b2-f994-468c-b444-dfbd90a6099d', '865f9a1d-aba5-48bd-b9cb-36cd783db8ae', '93a48e38-abe3-44a6-aa4c-b8c0cbb6e31c'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0725af9c-c246-4685-9419-3484ea1342d4 tempest-VolumesListAdminTestJSON-706827828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0725af9c-c246-4685-9419-3484ea1342d4 tempest-VolumesListAdminTestJSON-706827828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0725af9c-c246-4685-9419-3484ea1342d4 tempest-VolumesListAdminTestJSON-706827828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:49 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0725af9c-c246-4685-9419-3484ea1342d4 tempest-VolumesListAdminTestJSON-706827828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0725af9c-c246-4685-9419-3484ea1342d4 tempest-VolumesListAdminTestJSON-706827828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0725af9c-c246-4685-9419-3484ea1342d4 tempest-VolumesListAdminTestJSON-706827828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-416c8374-1ab8-45f4-a6fe-ce91cf4bae9a tempest-VolumesListAdminTestJSON-338408496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7d55675-7552-4bc3-a120-22bac930dcff" returned: 0 in 0.416s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-416c8374-1ab8-45f4-a6fe-ce91cf4bae9a tempest-VolumesListAdminTestJSON-338408496 None] Lock "cinder-quobyte-a7d55675-7552-4bc3-a120-22bac930dcff" released by "delete_volume" :: held 1.105s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:49 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:15:49 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-416c8374-1ab8-45f4-a6fe-ce91cf4bae9a tempest-VolumesListAdminTestJSON-338408496 None] Created reservations ['2fb29d64-e0be-4890-86d1-7698b8b4a3a6', '3d0e5f73-e4a7-4843-93cc-10e4f8d5df9b', 'bf5ebaf2-afd0-4ed1-ba6d-abe716d5c104', '8767cffd-e9eb-45eb-85fe-fc2f786a0321'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:49 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-416c8374-1ab8-45f4-a6fe-ce91cf4bae9a tempest-VolumesListAdminTestJSON-338408496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-416c8374-1ab8-45f4-a6fe-ce91cf4bae9a tempest-VolumesListAdminTestJSON-338408496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-416c8374-1ab8-45f4-a6fe-ce91cf4bae9a tempest-VolumesListAdminTestJSON-338408496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-416c8374-1ab8-45f4-a6fe-ce91cf4bae9a tempest-VolumesListAdminTestJSON-338408496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-416c8374-1ab8-45f4-a6fe-ce91cf4bae9a tempest-VolumesListAdminTestJSON-338408496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-416c8374-1ab8-45f4-a6fe-ce91cf4bae9a tempest-VolumesListAdminTestJSON-338408496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b5f55a9c-150c-4a51-aaf0-b77d3eabcf13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.439s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-b5f55a9c-150c-4a51-aaf0-b77d3eabcf13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:15:49 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b5f55a9c-150c-4a51-aaf0-b77d3eabcf13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Deleted volume successfully. Jul 22 12:15:49 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:15:49 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b5f55a9c-150c-4a51-aaf0-b77d3eabcf13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2085162683 None] Lock "cinder-0e49fad4-4cdc-4129-8d2a-d160c440901e-delete_volume" released by "delete_volume" :: held 2.110s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:49 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0725af9c-c246-4685-9419-3484ea1342d4 tempest-VolumesListAdminTestJSON-706827828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.415s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0725af9c-c246-4685-9419-3484ea1342d4 tempest-VolumesListAdminTestJSON-706827828 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:15:49 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-0725af9c-c246-4685-9419-3484ea1342d4 tempest-VolumesListAdminTestJSON-706827828 None] Deleted volume successfully. Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0725af9c-c246-4685-9419-3484ea1342d4 tempest-VolumesListAdminTestJSON-706827828 None] Lock "cinder-d68e0f69-e53f-42ca-9929-39af1cc7a26f-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:49 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-416c8374-1ab8-45f4-a6fe-ce91cf4bae9a tempest-VolumesListAdminTestJSON-338408496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.358s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-416c8374-1ab8-45f4-a6fe-ce91cf4bae9a tempest-VolumesListAdminTestJSON-338408496 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:15:49 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-416c8374-1ab8-45f4-a6fe-ce91cf4bae9a tempest-VolumesListAdminTestJSON-338408496 None] Deleted volume successfully. Jul 22 12:15:49 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-416c8374-1ab8-45f4-a6fe-ce91cf4bae9a tempest-VolumesListAdminTestJSON-338408496 None] Lock "cinder-a7d55675-7552-4bc3-a120-22bac930dcff-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:50 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b6a04008-1aa5-4a9a-8659-1dda548c7aff tempest-VolumesListAdminTestJSON-338408496 None] Acquiring lock "cinder-01bb79fd-0191-44e7-84c1-b2590526e108-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:50 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b6a04008-1aa5-4a9a-8659-1dda548c7aff tempest-VolumesListAdminTestJSON-338408496 None] Lock "cinder-01bb79fd-0191-44e7-84c1-b2590526e108-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:50 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b6a04008-1aa5-4a9a-8659-1dda548c7aff tempest-VolumesListAdminTestJSON-338408496 None] Acquiring lock "cinder-quobyte-01bb79fd-0191-44e7-84c1-b2590526e108" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:50 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b6a04008-1aa5-4a9a-8659-1dda548c7aff tempest-VolumesListAdminTestJSON-338408496 None] Lock "cinder-quobyte-01bb79fd-0191-44e7-84c1-b2590526e108" acquired by "delete_volume" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:50 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac01afc-5667-4ac6-abe8-2a7b85c8fbca]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b6a04008-1aa5-4a9a-8659-1dda548c7aff tempest-VolumesListAdminTestJSON-338408496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-01bb79fd-0191-44e7-84c1-b2590526e108 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:50 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-01bb79fd-0191-44e7-84c1-b2590526e108 Jul 22 12:15:50 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:50 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b6a04008-1aa5-4a9a-8659-1dda548c7aff tempest-VolumesListAdminTestJSON-338408496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-01bb79fd-0191-44e7-84c1-b2590526e108" returned: 0 in 0.419s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b6a04008-1aa5-4a9a-8659-1dda548c7aff tempest-VolumesListAdminTestJSON-338408496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-01bb79fd-0191-44e7-84c1-b2590526e108 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:50 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-01bb79fd-0191-44e7-84c1-b2590526e108 Jul 22 12:15:50 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:51 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b6a04008-1aa5-4a9a-8659-1dda548c7aff tempest-VolumesListAdminTestJSON-338408496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-01bb79fd-0191-44e7-84c1-b2590526e108" returned: 0 in 0.316s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:51 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b6a04008-1aa5-4a9a-8659-1dda548c7aff tempest-VolumesListAdminTestJSON-338408496 None] Lock "cinder-quobyte-01bb79fd-0191-44e7-84c1-b2590526e108" released by "delete_volume" :: held 0.787s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:51 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-b6a04008-1aa5-4a9a-8659-1dda548c7aff tempest-VolumesListAdminTestJSON-338408496 None] Created reservations ['1569a005-7c25-44c2-b2a2-e07733de8835', 'c8de670b-ce26-4fd4-8701-1db91b850696', '7a65b69e-8b3e-4a02-af4e-ef45bdc13136', '60ce8f3f-3e21-4bb0-b607-81f97f8fcad7'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b6a04008-1aa5-4a9a-8659-1dda548c7aff tempest-VolumesListAdminTestJSON-338408496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b6a04008-1aa5-4a9a-8659-1dda548c7aff tempest-VolumesListAdminTestJSON-338408496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b6a04008-1aa5-4a9a-8659-1dda548c7aff tempest-VolumesListAdminTestJSON-338408496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b6a04008-1aa5-4a9a-8659-1dda548c7aff tempest-VolumesListAdminTestJSON-338408496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b6a04008-1aa5-4a9a-8659-1dda548c7aff tempest-VolumesListAdminTestJSON-338408496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b6a04008-1aa5-4a9a-8659-1dda548c7aff tempest-VolumesListAdminTestJSON-338408496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:51 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:15:51 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:51 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-517bef06-3438-44d8-9dc7-b9eda7e8acd2 tempest-VolumesListAdminTestJSON-338408496 None] Acquiring lock "cinder-9557fb55-8a45-4c74-8a19-794a60f317aa-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:51 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-517bef06-3438-44d8-9dc7-b9eda7e8acd2 tempest-VolumesListAdminTestJSON-338408496 None] Lock "cinder-9557fb55-8a45-4c74-8a19-794a60f317aa-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:51 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-517bef06-3438-44d8-9dc7-b9eda7e8acd2 tempest-VolumesListAdminTestJSON-338408496 None] Acquiring lock "cinder-quobyte-9557fb55-8a45-4c74-8a19-794a60f317aa" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:51 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b6a04008-1aa5-4a9a-8659-1dda548c7aff tempest-VolumesListAdminTestJSON-338408496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.485s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:51 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-b6a04008-1aa5-4a9a-8659-1dda548c7aff tempest-VolumesListAdminTestJSON-338408496 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:15:51 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b6a04008-1aa5-4a9a-8659-1dda548c7aff tempest-VolumesListAdminTestJSON-338408496 None] Deleted volume successfully. Jul 22 12:15:51 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-517bef06-3438-44d8-9dc7-b9eda7e8acd2 tempest-VolumesListAdminTestJSON-338408496 None] Lock "cinder-quobyte-9557fb55-8a45-4c74-8a19-794a60f317aa" acquired by "delete_volume" :: waited 0.032s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:51 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b6a04008-1aa5-4a9a-8659-1dda548c7aff tempest-VolumesListAdminTestJSON-338408496 None] Lock "cinder-01bb79fd-0191-44e7-84c1-b2590526e108-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:51 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd4d597-646e-419d-995e-c6d391079ce3]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-517bef06-3438-44d8-9dc7-b9eda7e8acd2 tempest-VolumesListAdminTestJSON-338408496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9557fb55-8a45-4c74-8a19-794a60f317aa {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:52 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9557fb55-8a45-4c74-8a19-794a60f317aa Jul 22 12:15:52 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:15:52 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Flow 'volume_create_manager' (b4de1140-7be2-4758-bb5f-f057d4ebfbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7cb618-fd94-4ac4-a702-5c1e8cf99968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-517bef06-3438-44d8-9dc7-b9eda7e8acd2 tempest-VolumesListAdminTestJSON-338408496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9557fb55-8a45-4c74-8a19-794a60f317aa" returned: 0 in 0.516s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-517bef06-3438-44d8-9dc7-b9eda7e8acd2 tempest-VolumesListAdminTestJSON-338408496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9557fb55-8a45-4c74-8a19-794a60f317aa {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:52 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9557fb55-8a45-4c74-8a19-794a60f317aa Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7cb618-fd94-4ac4-a702-5c1e8cf99968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-286168192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62bc4b63-eadc-4597-b33c-39205e63cc15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ada5640032d4256be173eeaa4ea64d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:15:52Z,use_quota=True,user_id='59d598c527134293a836901aa0e3cd5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:52 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35adccae-aa92-4fcd-97b8-a30db683ceea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35adccae-aa92-4fcd-97b8-a30db683ceea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89025ccd-35e1-4643-9043-b68bb9440b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89025ccd-35e1-4643-9043-b68bb9440b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62bc4b63-eadc-4597-b33c-39205e63cc15', 'volume_name': 'volume-62bc4b63-eadc-4597-b33c-39205e63cc15', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6700fd7-5fa3-4093-b1bb-7d75686948a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6700fd7-5fa3-4093-b1bb-7d75686948a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d1a4530-6c35-46b7-9d7e-ef468ebcb06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:52 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Volume 62bc4b63-eadc-4597-b33c-39205e63cc15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62bc4b63-eadc-4597-b33c-39205e63cc15', 'volume_size': 1} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-286168192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62bc4b63-eadc-4597-b33c-39205e63cc15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ada5640032d4256be173eeaa4ea64d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:15:52Z,use_quota=True,user_id='59d598c527134293a836901aa0e3cd5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Creating volume 62bc4b63-eadc-4597-b33c-39205e63cc15 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:15:52 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-62bc4b63-eadc-4597-b33c-39205e63cc15 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:52 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-62bc4b63-eadc-4597-b33c-39205e63cc15 1073741824 Jul 22 12:15:52 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:52 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-517bef06-3438-44d8-9dc7-b9eda7e8acd2 tempest-VolumesListAdminTestJSON-338408496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9557fb55-8a45-4c74-8a19-794a60f317aa" returned: 0 in 0.319s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-517bef06-3438-44d8-9dc7-b9eda7e8acd2 tempest-VolumesListAdminTestJSON-338408496 None] Lock "cinder-quobyte-9557fb55-8a45-4c74-8a19-794a60f317aa" released by "delete_volume" :: held 0.909s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-517bef06-3438-44d8-9dc7-b9eda7e8acd2 tempest-VolumesListAdminTestJSON-338408496 None] Created reservations ['81a3c6a4-3971-45fe-81da-22e78e260828', 'bbdd45fa-68e6-4e52-b602-2c3a2280822e', '1c1d751f-e5b4-4b02-b87a-df64a860f57a', '2a829fbd-9abf-4954-a280-a70d04a99e0d'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-517bef06-3438-44d8-9dc7-b9eda7e8acd2 tempest-VolumesListAdminTestJSON-338408496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-517bef06-3438-44d8-9dc7-b9eda7e8acd2 tempest-VolumesListAdminTestJSON-338408496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-517bef06-3438-44d8-9dc7-b9eda7e8acd2 tempest-VolumesListAdminTestJSON-338408496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-517bef06-3438-44d8-9dc7-b9eda7e8acd2 tempest-VolumesListAdminTestJSON-338408496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-517bef06-3438-44d8-9dc7-b9eda7e8acd2 tempest-VolumesListAdminTestJSON-338408496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-517bef06-3438-44d8-9dc7-b9eda7e8acd2 tempest-VolumesListAdminTestJSON-338408496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:53 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:15:53 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:53 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-62bc4b63-eadc-4597-b33c-39205e63cc15 1073741824" returned: 0 in 0.561s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-62bc4b63-eadc-4597-b33c-39205e63cc15 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:53 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-62bc4b63-eadc-4597-b33c-39205e63cc15 Jul 22 12:15:53 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:53 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-517bef06-3438-44d8-9dc7-b9eda7e8acd2 tempest-VolumesListAdminTestJSON-338408496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.344s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:53 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-517bef06-3438-44d8-9dc7-b9eda7e8acd2 tempest-VolumesListAdminTestJSON-338408496 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:15:53 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-517bef06-3438-44d8-9dc7-b9eda7e8acd2 tempest-VolumesListAdminTestJSON-338408496 None] Deleted volume successfully. Jul 22 12:15:53 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-517bef06-3438-44d8-9dc7-b9eda7e8acd2 tempest-VolumesListAdminTestJSON-338408496 None] Lock "cinder-9557fb55-8a45-4c74-8a19-794a60f317aa-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:53 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-62bc4b63-eadc-4597-b33c-39205e63cc15" returned: 0 in 0.287s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:15:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d1a4530-6c35-46b7-9d7e-ef468ebcb06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62bc4b63-eadc-4597-b33c-39205e63cc15', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737586f2-b3be-4500-946a-314a449d64ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:53 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Volume volume-62bc4b63-eadc-4597-b33c-39205e63cc15 (62bc4b63-eadc-4597-b33c-39205e63cc15): created successfully Jul 22 12:15:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737586f2-b3be-4500-946a-314a449d64ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Flow 'volume_create_manager' (b4de1140-7be2-4758-bb5f-f057d4ebfbc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:53 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-333c2431-f9ca-4514-8192-dd0c707428d3 tempest-VolumesTransfersV355Test-1987616796 None] Created volume successfully. Jul 22 12:15:55 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-f4bf1d64-6017-4c38-af80-c141d71c0ffe tempest-VolumesTransfersV355Test-2024809444 None] Transfer volume completed successfully. Jul 22 12:15:55 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:15:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Flow 'volume_create_manager' (6a0e5f34-fbf6-4a9a-90b2-6d5efe86dc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be9f3c4-a2dc-4f5c-91a6-28fad13837b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be9f3c4-a2dc-4f5c-91a6-28fad13837b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1094614559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf636ca-4fad-4692-9cf3-9db68f558c90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37146e0d545b4552bbcc40ccc486bf5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:15:56Z,use_quota=True,user_id='17756cb4764641279c4223650378bb65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d37e4de-bd40-4797-9ec3-5f2d05e72e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d37e4de-bd40-4797-9ec3-5f2d05e72e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58706ec1-24b0-412c-ad53-14d72c166a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58706ec1-24b0-412c-ad53-14d72c166a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daf636ca-4fad-4692-9cf3-9db68f558c90', 'volume_name': 'volume-daf636ca-4fad-4692-9cf3-9db68f558c90', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (477e4092-2950-4a38-9e17-dd35f0eea91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (477e4092-2950-4a38-9e17-dd35f0eea91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a60fea0-79a1-46c9-ae02-0f90d1acedab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:55 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Volume daf636ca-4fad-4692-9cf3-9db68f558c90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daf636ca-4fad-4692-9cf3-9db68f558c90', 'volume_size': 1} Jul 22 12:15:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:55 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1094614559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf636ca-4fad-4692-9cf3-9db68f558c90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37146e0d545b4552bbcc40ccc486bf5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:15:56Z,use_quota=True,user_id='17756cb4764641279c4223650378bb65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:15:55 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Creating volume daf636ca-4fad-4692-9cf3-9db68f558c90 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:15:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:55 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:55 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:55 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:15:55 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:15:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-daf636ca-4fad-4692-9cf3-9db68f558c90 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:55 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-daf636ca-4fad-4692-9cf3-9db68f558c90 1073741824 Jul 22 12:15:55 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-fb3d7970-fc01-4936-9b26-53d424129673 tempest-VolumesTransfersV355Test-1261545147 None] Acquiring lock "cinder-62bc4b63-eadc-4597-b33c-39205e63cc15-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-fb3d7970-fc01-4936-9b26-53d424129673 tempest-VolumesTransfersV355Test-1261545147 None] Lock "cinder-62bc4b63-eadc-4597-b33c-39205e63cc15-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-fb3d7970-fc01-4936-9b26-53d424129673 tempest-VolumesTransfersV355Test-1261545147 None] Acquiring lock "cinder-quobyte-62bc4b63-eadc-4597-b33c-39205e63cc15" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-fb3d7970-fc01-4936-9b26-53d424129673 tempest-VolumesTransfersV355Test-1261545147 None] Lock "cinder-quobyte-62bc4b63-eadc-4597-b33c-39205e63cc15" acquired by "delete_volume" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:56 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91d11d5-7edc-47ba-9f8d-e54437165979]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fb3d7970-fc01-4936-9b26-53d424129673 tempest-VolumesTransfersV355Test-1261545147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-62bc4b63-eadc-4597-b33c-39205e63cc15 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:56 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:56 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-62bc4b63-eadc-4597-b33c-39205e63cc15 Jul 22 12:15:56 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-daf636ca-4fad-4692-9cf3-9db68f558c90 1073741824" returned: 0 in 0.597s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-daf636ca-4fad-4692-9cf3-9db68f558c90 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:56 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-daf636ca-4fad-4692-9cf3-9db68f558c90 Jul 22 12:15:56 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:56 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fb3d7970-fc01-4936-9b26-53d424129673 tempest-VolumesTransfersV355Test-1261545147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-62bc4b63-eadc-4597-b33c-39205e63cc15" returned: 0 in 0.453s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fb3d7970-fc01-4936-9b26-53d424129673 tempest-VolumesTransfersV355Test-1261545147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-62bc4b63-eadc-4597-b33c-39205e63cc15 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:56 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-62bc4b63-eadc-4597-b33c-39205e63cc15 Jul 22 12:15:56 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:56 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-daf636ca-4fad-4692-9cf3-9db68f558c90" returned: 0 in 0.422s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:56 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:15:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:56 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a60fea0-79a1-46c9-ae02-0f90d1acedab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daf636ca-4fad-4692-9cf3-9db68f558c90', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:56 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193a86f2-5de9-4553-8bd7-3b55a9ccc357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:56 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Volume volume-daf636ca-4fad-4692-9cf3-9db68f558c90 (daf636ca-4fad-4692-9cf3-9db68f558c90): created successfully Jul 22 12:15:56 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193a86f2-5de9-4553-8bd7-3b55a9ccc357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:56 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Flow 'volume_create_manager' (6a0e5f34-fbf6-4a9a-90b2-6d5efe86dc91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:56 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-26f225fa-ebf2-40b8-81a5-a6ca17f1bbe6 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Created volume successfully. Jul 22 12:15:56 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fb3d7970-fc01-4936-9b26-53d424129673 tempest-VolumesTransfersV355Test-1261545147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-62bc4b63-eadc-4597-b33c-39205e63cc15" returned: 0 in 0.288s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-fb3d7970-fc01-4936-9b26-53d424129673 tempest-VolumesTransfersV355Test-1261545147 None] Lock "cinder-quobyte-62bc4b63-eadc-4597-b33c-39205e63cc15" released by "delete_volume" :: held 0.802s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:57 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-fb3d7970-fc01-4936-9b26-53d424129673 tempest-VolumesTransfersV355Test-1261545147 None] Created reservations ['61172196-e58a-4cfe-b6de-27c31764c203', 'cb294b11-e9e1-4f1b-be6a-0b15486150d8', '42813aab-6651-4b7c-8c24-c55fae175d12', '470822d5-a355-46ff-a4db-966366be212a'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fb3d7970-fc01-4936-9b26-53d424129673 tempest-VolumesTransfersV355Test-1261545147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fb3d7970-fc01-4936-9b26-53d424129673 tempest-VolumesTransfersV355Test-1261545147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-fb3d7970-fc01-4936-9b26-53d424129673 tempest-VolumesTransfersV355Test-1261545147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-fb3d7970-fc01-4936-9b26-53d424129673 tempest-VolumesTransfersV355Test-1261545147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fb3d7970-fc01-4936-9b26-53d424129673 tempest-VolumesTransfersV355Test-1261545147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fb3d7970-fc01-4936-9b26-53d424129673 tempest-VolumesTransfersV355Test-1261545147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:57 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:15:57 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:57 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fb3d7970-fc01-4936-9b26-53d424129673 tempest-VolumesTransfersV355Test-1261545147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.288s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:57 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-fb3d7970-fc01-4936-9b26-53d424129673 tempest-VolumesTransfersV355Test-1261545147 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:15:57 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-fb3d7970-fc01-4936-9b26-53d424129673 tempest-VolumesTransfersV355Test-1261545147 None] Deleted volume successfully. Jul 22 12:15:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-fb3d7970-fc01-4936-9b26-53d424129673 tempest-VolumesTransfersV355Test-1261545147 None] Lock "cinder-62bc4b63-eadc-4597-b33c-39205e63cc15-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6e611dfc-f1d3-489d-a793-e19dddbf7f70 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Acquiring lock "cinder-daf636ca-4fad-4692-9cf3-9db68f558c90-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6e611dfc-f1d3-489d-a793-e19dddbf7f70 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Lock "cinder-daf636ca-4fad-4692-9cf3-9db68f558c90-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6e611dfc-f1d3-489d-a793-e19dddbf7f70 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Acquiring lock "cinder-quobyte-daf636ca-4fad-4692-9cf3-9db68f558c90" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Flow 'volume_create_manager' (7d4424d4-1758-4e47-946f-f7780d02014f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575bac20-6fd3-4dae-9304-b2ad2b36d87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6e611dfc-f1d3-489d-a793-e19dddbf7f70 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Lock "cinder-quobyte-daf636ca-4fad-4692-9cf3-9db68f558c90" acquired by "delete_volume" :: waited 0.066s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575bac20-6fd3-4dae-9304-b2ad2b36d87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1147479829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ddb612-c256-42f0-947f-9df0d9d5842e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ada5640032d4256be173eeaa4ea64d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:15:58Z,use_quota=True,user_id='59d598c527134293a836901aa0e3cd5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f38bb9-cadf-468c-96a7-28747fa9580b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f38bb9-cadf-468c-96a7-28747fa9580b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b59464-eb17-4708-b725-007a09645419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b59464-eb17-4708-b725-007a09645419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96ddb612-c256-42f0-947f-9df0d9d5842e', 'volume_name': 'volume-96ddb612-c256-42f0-947f-9df0d9d5842e', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c12197-cea8-4a75-ae05-0685374886fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c12197-cea8-4a75-ae05-0685374886fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38750b3c-a841-4ea0-83dd-fec1e3d6d164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:58 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Volume 96ddb612-c256-42f0-947f-9df0d9d5842e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96ddb612-c256-42f0-947f-9df0d9d5842e', 'volume_size': 1} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1147479829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ddb612-c256-42f0-947f-9df0d9d5842e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ada5640032d4256be173eeaa4ea64d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:15:58Z,use_quota=True,user_id='59d598c527134293a836901aa0e3cd5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Creating volume 96ddb612-c256-42f0-947f-9df0d9d5842e {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:15:58 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-96ddb612-c256-42f0-947f-9df0d9d5842e 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[909120ba-44c2-4e28-b2ec-6fe9f6b54eb6]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6e611dfc-f1d3-489d-a793-e19dddbf7f70 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-daf636ca-4fad-4692-9cf3-9db68f558c90 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:58 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-96ddb612-c256-42f0-947f-9df0d9d5842e 1073741824 Jul 22 12:15:58 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:58 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-daf636ca-4fad-4692-9cf3-9db68f558c90 Jul 22 12:15:58 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:58 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6e611dfc-f1d3-489d-a793-e19dddbf7f70 tempest-VolumeQuotasAdminTestJSON-1287324436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-daf636ca-4fad-4692-9cf3-9db68f558c90" returned: 0 in 0.447s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6e611dfc-f1d3-489d-a793-e19dddbf7f70 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-daf636ca-4fad-4692-9cf3-9db68f558c90 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:58 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-daf636ca-4fad-4692-9cf3-9db68f558c90 Jul 22 12:15:58 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:58 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-96ddb612-c256-42f0-947f-9df0d9d5842e 1073741824" returned: 0 in 0.544s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-96ddb612-c256-42f0-947f-9df0d9d5842e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:58 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-96ddb612-c256-42f0-947f-9df0d9d5842e Jul 22 12:15:58 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:58 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6e611dfc-f1d3-489d-a793-e19dddbf7f70 tempest-VolumeQuotasAdminTestJSON-1287324436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-daf636ca-4fad-4692-9cf3-9db68f558c90" returned: 0 in 0.347s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6e611dfc-f1d3-489d-a793-e19dddbf7f70 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Lock "cinder-quobyte-daf636ca-4fad-4692-9cf3-9db68f558c90" released by "delete_volume" :: held 0.952s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:15:59 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-6e611dfc-f1d3-489d-a793-e19dddbf7f70 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Created reservations ['3e0e3dce-27e6-4990-b5f8-bff32ae67f11', '05bc6db9-cfa7-44c7-ae20-78780742d947', 'e0fefcd4-7414-4b8e-8425-4d73a9a27cd1', 'fbcb6aca-5c33-4a96-bad8-ce21dd682c9b'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:15:59 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-96ddb612-c256-42f0-947f-9df0d9d5842e" returned: 0 in 0.363s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:15:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38750b3c-a841-4ea0-83dd-fec1e3d6d164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96ddb612-c256-42f0-947f-9df0d9d5842e', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49975f6-7caf-402e-9856-c420fa60fd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:15:59 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Volume volume-96ddb612-c256-42f0-947f-9df0d9d5842e (96ddb612-c256-42f0-947f-9df0d9d5842e): created successfully Jul 22 12:15:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49975f6-7caf-402e-9856-c420fa60fd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:15:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Flow 'volume_create_manager' (7d4424d4-1758-4e47-946f-f7780d02014f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:15:59 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-7af7081c-66ef-4bec-a2ed-be8e4ecf1625 tempest-VolumesTransfersV355Test-1987616796 None] Created volume successfully. Jul 22 12:15:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6e611dfc-f1d3-489d-a793-e19dddbf7f70 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:15:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6e611dfc-f1d3-489d-a793-e19dddbf7f70 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:15:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6e611dfc-f1d3-489d-a793-e19dddbf7f70 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:15:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6e611dfc-f1d3-489d-a793-e19dddbf7f70 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:15:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6e611dfc-f1d3-489d-a793-e19dddbf7f70 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:15:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6e611dfc-f1d3-489d-a793-e19dddbf7f70 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:15:59 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:15:59 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:15:59 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Jul 22 12:15:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6e611dfc-f1d3-489d-a793-e19dddbf7f70 tempest-VolumeQuotasAdminTestJSON-1287324436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.289s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:15:59 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-6e611dfc-f1d3-489d-a793-e19dddbf7f70 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:15:59 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-6e611dfc-f1d3-489d-a793-e19dddbf7f70 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Deleted volume successfully. Jul 22 12:15:59 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6e611dfc-f1d3-489d-a793-e19dddbf7f70 tempest-VolumeQuotasAdminTestJSON-1287324436 None] Lock "cinder-daf636ca-4fad-4692-9cf3-9db68f558c90-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2257c5b7-ec13-4ed2-8c04-f78d21d4bb77 tempest-VolumesTransfersV355Test-1261545147 None] Acquiring lock "cinder-96ddb612-c256-42f0-947f-9df0d9d5842e-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2257c5b7-ec13-4ed2-8c04-f78d21d4bb77 tempest-VolumesTransfersV355Test-1261545147 None] Lock "cinder-96ddb612-c256-42f0-947f-9df0d9d5842e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2257c5b7-ec13-4ed2-8c04-f78d21d4bb77 tempest-VolumesTransfersV355Test-1261545147 None] Acquiring lock "cinder-quobyte-96ddb612-c256-42f0-947f-9df0d9d5842e" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2257c5b7-ec13-4ed2-8c04-f78d21d4bb77 tempest-VolumesTransfersV355Test-1261545147 None] Lock "cinder-quobyte-96ddb612-c256-42f0-947f-9df0d9d5842e" acquired by "delete_volume" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:00 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e536fa8c-3397-4f63-aef7-1bf7703831bc]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2257c5b7-ec13-4ed2-8c04-f78d21d4bb77 tempest-VolumesTransfersV355Test-1261545147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-96ddb612-c256-42f0-947f-9df0d9d5842e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:00 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-96ddb612-c256-42f0-947f-9df0d9d5842e Jul 22 12:16:00 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:00 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:UPDATE=216,cinder:SELECT=166,cinder:INSERT=55,cinder:DELETE=18 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:16:00 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:16:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Flow 'volume_create_manager' (a0582141-097d-4f2a-bebb-2808bfdacddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171dcf67-1a0e-4c88-b0df-cdf96df97535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171dcf67-1a0e-4c88-b0df-cdf96df97535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1838885940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36dd0abb-1d49-4189-81a5-15d58793d899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37146e0d545b4552bbcc40ccc486bf5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:01Z,use_quota=True,user_id='17756cb4764641279c4223650378bb65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8dd8a5f-b09d-4733-8f49-2b991934a3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8dd8a5f-b09d-4733-8f49-2b991934a3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e299da9-d966-486d-9756-255a8243689b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e299da9-d966-486d-9756-255a8243689b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36dd0abb-1d49-4189-81a5-15d58793d899', 'volume_name': 'volume-36dd0abb-1d49-4189-81a5-15d58793d899', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530616de-bbef-45d1-a8a4-7818a9613d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530616de-bbef-45d1-a8a4-7818a9613d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee3aaa2-cb6c-4c44-ba9d-de08acdab7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:01 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Volume 36dd0abb-1d49-4189-81a5-15d58793d899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36dd0abb-1d49-4189-81a5-15d58793d899', 'volume_size': 1} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1838885940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36dd0abb-1d49-4189-81a5-15d58793d899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37146e0d545b4552bbcc40ccc486bf5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:01Z,use_quota=True,user_id='17756cb4764641279c4223650378bb65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Creating volume 36dd0abb-1d49-4189-81a5-15d58793d899 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:01 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:16:01 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-36dd0abb-1d49-4189-81a5-15d58793d899 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2257c5b7-ec13-4ed2-8c04-f78d21d4bb77 tempest-VolumesTransfersV355Test-1261545147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-96ddb612-c256-42f0-947f-9df0d9d5842e" returned: 0 in 0.536s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2257c5b7-ec13-4ed2-8c04-f78d21d4bb77 tempest-VolumesTransfersV355Test-1261545147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-96ddb612-c256-42f0-947f-9df0d9d5842e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:01 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-36dd0abb-1d49-4189-81a5-15d58793d899 1073741824 Jul 22 12:16:01 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:01 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-96ddb612-c256-42f0-947f-9df0d9d5842e Jul 22 12:16:01 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:01 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2257c5b7-ec13-4ed2-8c04-f78d21d4bb77 tempest-VolumesTransfersV355Test-1261545147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-96ddb612-c256-42f0-947f-9df0d9d5842e" returned: 0 in 0.308s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2257c5b7-ec13-4ed2-8c04-f78d21d4bb77 tempest-VolumesTransfersV355Test-1261545147 None] Lock "cinder-quobyte-96ddb612-c256-42f0-947f-9df0d9d5842e" released by "delete_volume" :: held 0.900s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-2257c5b7-ec13-4ed2-8c04-f78d21d4bb77 tempest-VolumesTransfersV355Test-1261545147 None] Created reservations ['d2377b11-94be-4a5e-997e-092a295d1508', '3ae1faa2-f6c8-41b4-8ac1-51bf92609b80', '08739bbb-5f86-4615-a1b0-ffe253c2331e', '24ac7637-0967-42a7-b52a-f462291f3580'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2257c5b7-ec13-4ed2-8c04-f78d21d4bb77 tempest-VolumesTransfersV355Test-1261545147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2257c5b7-ec13-4ed2-8c04-f78d21d4bb77 tempest-VolumesTransfersV355Test-1261545147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2257c5b7-ec13-4ed2-8c04-f78d21d4bb77 tempest-VolumesTransfersV355Test-1261545147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2257c5b7-ec13-4ed2-8c04-f78d21d4bb77 tempest-VolumesTransfersV355Test-1261545147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2257c5b7-ec13-4ed2-8c04-f78d21d4bb77 tempest-VolumesTransfersV355Test-1261545147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2257c5b7-ec13-4ed2-8c04-f78d21d4bb77 tempest-VolumesTransfersV355Test-1261545147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:01 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-36dd0abb-1d49-4189-81a5-15d58793d899 1073741824" returned: 0 in 0.560s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:01 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:16:01 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-36dd0abb-1d49-4189-81a5-15d58793d899 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:01 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-36dd0abb-1d49-4189-81a5-15d58793d899 Jul 22 12:16:01 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:01 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2257c5b7-ec13-4ed2-8c04-f78d21d4bb77 tempest-VolumesTransfersV355Test-1261545147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.348s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:01 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-2257c5b7-ec13-4ed2-8c04-f78d21d4bb77 tempest-VolumesTransfersV355Test-1261545147 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:16:01 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-2257c5b7-ec13-4ed2-8c04-f78d21d4bb77 tempest-VolumesTransfersV355Test-1261545147 None] Deleted volume successfully. Jul 22 12:16:02 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2257c5b7-ec13-4ed2-8c04-f78d21d4bb77 tempest-VolumesTransfersV355Test-1261545147 None] Lock "cinder-96ddb612-c256-42f0-947f-9df0d9d5842e-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:02 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-36dd0abb-1d49-4189-81a5-15d58793d899" returned: 0 in 0.352s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:16:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:02 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=186,cinder:UPDATE=223,cinder:INSERT=50,cinder:DELETE=14 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:16:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee3aaa2-cb6c-4c44-ba9d-de08acdab7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36dd0abb-1d49-4189-81a5-15d58793d899', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98536f13-f660-466b-bb32-c537884c3cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:02 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Volume volume-36dd0abb-1d49-4189-81a5-15d58793d899 (36dd0abb-1d49-4189-81a5-15d58793d899): created successfully Jul 22 12:16:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98536f13-f660-466b-bb32-c537884c3cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Flow 'volume_create_manager' (a0582141-097d-4f2a-bebb-2808bfdacddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:02 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-f27c7644-6e7c-456b-9a85-79c38bb5b34e tempest-VolumeQuotasAdminTestJSON-1287324436 None] Created volume successfully. Jul 22 12:16:03 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:16:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Flow 'volume_create_manager' (93b6fad8-7455-42a4-8a33-d30c8475c02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61fcc45-e0f0-45db-b24e-3b3fd640c0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61fcc45-e0f0-45db-b24e-3b3fd640c0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1068017350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51920d30-2422-4921-9428-0f592176c398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21eac23adcb84d60a4d0f5571d779dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:03Z,use_quota=True,user_id='5e15479ebaad443da2cd29840ceb0030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ef40ac-877c-4d4d-93c1-112f0b4ffcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ef40ac-877c-4d4d-93c1-112f0b4ffcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c280a6-8fce-4d73-9ad8-3252d844a373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:03 devstack cinder-volume[87568]: DEBUG cinder.image.glance [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Creating Keystone auth plugin from conf {{(pid=87568) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 12:16:04 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-c3e9724d-20cc-4359-b5cc-0f3716705c2e tempest-VolumeQuotasAdminTestJSON-842877041 None] Transfer volume completed successfully. Jul 22 12:16:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f4d48b05-54e6-488a-a3f8-7d5b7d423e1e tempest-VolumeQuotasAdminTestJSON-1435675843 None] Acquiring lock "cinder-36dd0abb-1d49-4189-81a5-15d58793d899-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f4d48b05-54e6-488a-a3f8-7d5b7d423e1e tempest-VolumeQuotasAdminTestJSON-1435675843 None] Lock "cinder-36dd0abb-1d49-4189-81a5-15d58793d899-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f4d48b05-54e6-488a-a3f8-7d5b7d423e1e tempest-VolumeQuotasAdminTestJSON-1435675843 None] Acquiring lock "cinder-quobyte-36dd0abb-1d49-4189-81a5-15d58793d899" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:05 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c280a6-8fce-4d73-9ad8-3252d844a373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '51920d30-2422-4921-9428-0f592176c398', 'volume_name': 'volume-51920d30-2422-4921-9428-0f592176c398', 'volume_size': 1, 'image_id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fe02ba8749e04b7eaeb23823f684fdc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'created_at': datetime.datetime(2026, 7, 22, 10, 2, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 2, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:05 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d441efab-7fc8-40b8-96fb-025a629bbe74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:05 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d441efab-7fc8-40b8-96fb-025a629bbe74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:05 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a0d402-b12d-4a2f-909c-b5e9663c99e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:05 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Volume 51920d30-2422-4921-9428-0f592176c398: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-51920d30-2422-4921-9428-0f592176c398', 'volume_size': 1, 'image_id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fe02ba8749e04b7eaeb23823f684fdc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'created_at': datetime.datetime(2026, 7, 22, 10, 2, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 2, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 22 12:16:05 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Trying to clone 51920d30-2422-4921-9428-0f592176c398 from image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e at location (None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}]). {{(pid=87568) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 12:16:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f4d48b05-54e6-488a-a3f8-7d5b7d423e1e tempest-VolumeQuotasAdminTestJSON-1435675843 None] Lock "cinder-quobyte-36dd0abb-1d49-4189-81a5-15d58793d899" acquired by "delete_volume" :: waited 0.053s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:05 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[947128a3-d98c-4d51-a6e7-b989bf33e465]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f4d48b05-54e6-488a-a3f8-7d5b7d423e1e tempest-VolumeQuotasAdminTestJSON-1435675843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-36dd0abb-1d49-4189-81a5-15d58793d899 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:05 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-36dd0abb-1d49-4189-81a5-15d58793d899 Jul 22 12:16:05 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:05 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5d7hzw3adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 12:16:05 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Image download 20.69 MB at 20.69 MB/s Jul 22 12:16:05 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90ee0b5-dcae-4206-b674-70d16ca45979]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5d7hzw3adevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:05 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f4d48b05-54e6-488a-a3f8-7d5b7d423e1e tempest-VolumeQuotasAdminTestJSON-1435675843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-36dd0abb-1d49-4189-81a5-15d58793d899" returned: 0 in 0.522s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f4d48b05-54e6-488a-a3f8-7d5b7d423e1e tempest-VolumeQuotasAdminTestJSON-1435675843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-36dd0abb-1d49-4189-81a5-15d58793d899 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:05 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-36dd0abb-1d49-4189-81a5-15d58793d899 Jul 22 12:16:05 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:05 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5d7hzw3adevstack@QuobyteHD Jul 22 12:16:05 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:05 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f4d48b05-54e6-488a-a3f8-7d5b7d423e1e tempest-VolumeQuotasAdminTestJSON-1435675843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-36dd0abb-1d49-4189-81a5-15d58793d899" returned: 0 in 0.318s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f4d48b05-54e6-488a-a3f8-7d5b7d423e1e tempest-VolumeQuotasAdminTestJSON-1435675843 None] Lock "cinder-quobyte-36dd0abb-1d49-4189-81a5-15d58793d899" released by "delete_volume" :: held 0.915s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-f4d48b05-54e6-488a-a3f8-7d5b7d423e1e tempest-VolumeQuotasAdminTestJSON-1435675843 None] Created reservations ['a654b9ad-c402-4553-9566-9c7b62be8ded', '4ce18127-761a-4bb3-a77e-d7f765e2a3b3', 'e204adf1-0da5-45c3-b5ed-a172de2c5130', '928a3bfc-1f63-442b-8f0d-9239e1860601'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:16:06 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5d7hzw3adevstack@QuobyteHD" returned: 0 in 0.482s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Temporary image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e is fetched for user 5e15479ebaad443da2cd29840ceb0030. {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f4d48b05-54e6-488a-a3f8-7d5b7d423e1e tempest-VolumeQuotasAdminTestJSON-1435675843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f4d48b05-54e6-488a-a3f8-7d5b7d423e1e tempest-VolumeQuotasAdminTestJSON-1435675843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f4d48b05-54e6-488a-a3f8-7d5b7d423e1e tempest-VolumeQuotasAdminTestJSON-1435675843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f4d48b05-54e6-488a-a3f8-7d5b7d423e1e tempest-VolumeQuotasAdminTestJSON-1435675843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f4d48b05-54e6-488a-a3f8-7d5b7d423e1e tempest-VolumeQuotasAdminTestJSON-1435675843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f4d48b05-54e6-488a-a3f8-7d5b7d423e1e tempest-VolumeQuotasAdminTestJSON-1435675843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:06 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:16:06 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b30abe-0a78-4502-8a9d-f7927d8b47bd]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5d7hzw3adevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:06 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5d7hzw3adevstack@QuobyteHD Jul 22 12:16:06 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:06 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f4d48b05-54e6-488a-a3f8-7d5b7d423e1e tempest-VolumeQuotasAdminTestJSON-1435675843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.316s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-f4d48b05-54e6-488a-a3f8-7d5b7d423e1e tempest-VolumeQuotasAdminTestJSON-1435675843 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:16:06 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-f4d48b05-54e6-488a-a3f8-7d5b7d423e1e tempest-VolumeQuotasAdminTestJSON-1435675843 None] Deleted volume successfully. Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f4d48b05-54e6-488a-a3f8-7d5b7d423e1e tempest-VolumeQuotasAdminTestJSON-1435675843 None] Lock "cinder-36dd0abb-1d49-4189-81a5-15d58793d899-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:06 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5d7hzw3adevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1068017350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51920d30-2422-4921-9428-0f592176c398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21eac23adcb84d60a4d0f5571d779dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:03Z,use_quota=True,user_id='5e15479ebaad443da2cd29840ceb0030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Creating volume 51920d30-2422-4921-9428-0f592176c398 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:16:06 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:16:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51920d30-2422-4921-9428-0f592176c398 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:06 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51920d30-2422-4921-9428-0f592176c398 1073741824 Jul 22 12:16:06 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:07 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51920d30-2422-4921-9428-0f592176c398 1073741824" returned: 0 in 0.607s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51920d30-2422-4921-9428-0f592176c398 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:07 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51920d30-2422-4921-9428-0f592176c398 Jul 22 12:16:07 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:07 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51920d30-2422-4921-9428-0f592176c398" returned: 0 in 0.352s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:16:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:07 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Attempting download of 97d73ec3-9d73-4df3-baa6-cc90fa33d35e ((None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}])) to volume 51920d30-2422-4921-9428-0f592176c398. {{(pid=87568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 12:16:07 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e44f65-8846-447f-88aa-ded2dcffb8a4]: (4, 'raw') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_u0e4z4ry {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:07 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_u0e4z4ry Jul 22 12:16:07 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:08 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_u0e4z4ry" returned: 0 in 0.387s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_u0e4z4ry {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:08 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_u0e4z4ry Jul 22 12:16:08 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:08 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_u0e4z4ry" returned: 1 in 0.385s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_u0e4z4ry' failed. Not Retrying. {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e669c47e-9f9b-4e6c-bdbc-cba89d8bffbe]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5d7hzw3adevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:08 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5d7hzw3adevstack@QuobyteHD Jul 22 12:16:08 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Flow 'volume_create_manager' (3c5fff9d-f8a9-428e-935a-5adc78e97d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ebdb21-863a-4e94-857b-194962f4975d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ebdb21-863a-4e94-857b-194962f4975d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-334107634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22603519-e4c6-4db4-9066-3fc27a01c864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383bc7524f38422a9c62c2215b1250e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:09Z,use_quota=True,user_id='a559f6cc69f740e88d2b30f78aee6f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5a965d-5291-4e0b-aec9-6e42272d41dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5a965d-5291-4e0b-aec9-6e42272d41dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085e45f2-6731-465a-a3b3-ddc31f06ab93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085e45f2-6731-465a-a3b3-ddc31f06ab93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22603519-e4c6-4db4-9066-3fc27a01c864', 'volume_name': 'volume-22603519-e4c6-4db4-9066-3fc27a01c864', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aabb1582-4ace-4878-afb2-14665b1c035b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aabb1582-4ace-4878-afb2-14665b1c035b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c247f7fd-d669-4b4e-b32f-81337488d937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:08 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Volume 22603519-e4c6-4db4-9066-3fc27a01c864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22603519-e4c6-4db4-9066-3fc27a01c864', 'volume_size': 1} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-334107634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22603519-e4c6-4db4-9066-3fc27a01c864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383bc7524f38422a9c62c2215b1250e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:09Z,use_quota=True,user_id='a559f6cc69f740e88d2b30f78aee6f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Creating volume 22603519-e4c6-4db4-9066-3fc27a01c864 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:16:08 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:16:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:09 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864 1073741824 Jul 22 12:16:09 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:09 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5d7hzw3adevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:09 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] 97d73ec3-9d73-4df3-baa6-cc90fa33d35e was qcow2, converting to qcow2 {{(pid=87568) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 12:16:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5d7hzw3adevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51920d30-2422-4921-9428-0f592176c398 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:09 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5d7hzw3adevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51920d30-2422-4921-9428-0f592176c398 Jul 22 12:16:09 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:09 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864 1073741824" returned: 0 in 0.530s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:09 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864 Jul 22 12:16:09 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:09 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864" returned: 0 in 0.302s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:09 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:16:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:09 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c247f7fd-d669-4b4e-b32f-81337488d937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22603519-e4c6-4db4-9066-3fc27a01c864', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:09 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c955cc5-e480-441b-8ea4-781839b92dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:09 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Volume volume-22603519-e4c6-4db4-9066-3fc27a01c864 (22603519-e4c6-4db4-9066-3fc27a01c864): created successfully Jul 22 12:16:09 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c955cc5-e480-441b-8ea4-781839b92dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:09 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Flow 'volume_create_manager' (3c5fff9d-f8a9-428e-935a-5adc78e97d9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:09 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-361df3c8-93e8-43e2-b84b-19d84c4c6809 tempest-VolumesCloneTest-716414601 None] Created volume successfully. Jul 22 12:16:11 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5d7hzw3adevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51920d30-2422-4921-9428-0f592176c398" returned: 0 in 2.447s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:11 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5d7hzw3adevstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51920d30-2422-4921-9428-0f592176c398 {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:16:11 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Converted 112.00 MB image at 45.74 MB/s Jul 22 12:16:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51920d30-2422-4921-9428-0f592176c398 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:11 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51920d30-2422-4921-9428-0f592176c398 1G Jul 22 12:16:11 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:11 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:16:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Flow 'volume_create_manager' (ccf09090-91af-4e02-9849-12fecb5c7fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cd60f7-1aa8-4544-b8f5-e69050605e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cd60f7-1aa8-4544-b8f5-e69050605e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-831451799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be7b624e-d679-4c5f-a98b-b57f406efa79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383bc7524f38422a9c62c2215b1250e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=22603519-e4c6-4db4-9066-3fc27a01c864,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:12Z,use_quota=True,user_id='a559f6cc69f740e88d2b30f78aee6f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1026b31-5185-444f-a777-b4c8fbc093c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1026b31-5185-444f-a777-b4c8fbc093c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0527bbe-d771-4080-a0e1-8853e1b3414c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0527bbe-d771-4080-a0e1-8853e1b3414c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'be7b624e-d679-4c5f-a98b-b57f406efa79', 'volume_name': 'volume-be7b624e-d679-4c5f-a98b-b57f406efa79', 'volume_size': 2, 'source_volid': '22603519-e4c6-4db4-9066-3fc27a01c864', 'source_volstatus': 'available'}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07bca9d5-d82e-4a27-a8f0-bdfc3e0bf8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07bca9d5-d82e-4a27-a8f0-bdfc3e0bf8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bdd2d0f-2bab-43c7-966f-26a4b911d8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:11 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Volume be7b624e-d679-4c5f-a98b-b57f406efa79: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-be7b624e-d679-4c5f-a98b-b57f406efa79', 'volume_size': 2, 'source_volid': '22603519-e4c6-4db4-9066-3fc27a01c864', 'source_volstatus': 'available'} Jul 22 12:16:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:11 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Cloning volume 22603519-e4c6-4db4-9066-3fc27a01c864 to volume be7b624e-d679-4c5f-a98b-b57f406efa79 Jul 22 12:16:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Creating offline snapshot 1919cca1-5313-4377-9471-a66cc925e7cb of volume 22603519-e4c6-4db4-9066-3fc27a01c864 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:16:11 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09bcbba-2534-4d24-baf9-d2b99a8dd007]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:12 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51920d30-2422-4921-9428-0f592176c398 1G" returned: 0 in 0.479s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:12 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Downloaded image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e ((None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}])) to volume 51920d30-2422-4921-9428-0f592176c398 successfully. {{(pid=87568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 12:16:12 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Temporary image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e for user 5e15479ebaad443da2cd29840ceb0030 is deleted. {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 12:16:12 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Marking volume 51920d30-2422-4921-9428-0f592176c398 as bootable. {{(pid=87568) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 12:16:12 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Copying metadata from image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e to 51920d30-2422-4921-9428-0f592176c398. {{(pid=87568) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 12:16:12 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Creating volume glance metadata for volume 51920d30-2422-4921-9428-0f592176c398 backed by image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87568) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 12:16:12 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864 Jul 22 12:16:12 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a0d402-b12d-4a2f-909c-b5e9663c99e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51920d30-2422-4921-9428-0f592176c398', 'volume_size': 1, 'image_id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fe02ba8749e04b7eaeb23823f684fdc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'created_at': datetime.datetime(2026, 7, 22, 10, 2, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 2, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1c9dca-554e-4bb7-b16f-27565d12444b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:12 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Volume volume-51920d30-2422-4921-9428-0f592176c398 (51920d30-2422-4921-9428-0f592176c398): created successfully Jul 22 12:16:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1c9dca-554e-4bb7-b16f-27565d12444b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Flow 'volume_create_manager' (93b6fad8-7455-42a4-8a33-d30c8475c02e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:12 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-50fee0d9-740d-447e-84a0-c6be9f0ed91b tempest-VolumesImageMetadata-878954286 None] Created volume successfully. Jul 22 12:16:12 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864" returned: 0 in 0.519s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:12 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb 1G Jul 22 12:16:12 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-099a02cb-4e71-4d03-9580-d46cae703a27 tempest-VolumesImageMetadata-878954286 None] Acquiring lock "cinder-51920d30-2422-4921-9428-0f592176c398-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-099a02cb-4e71-4d03-9580-d46cae703a27 tempest-VolumesImageMetadata-878954286 None] Lock "cinder-51920d30-2422-4921-9428-0f592176c398-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-099a02cb-4e71-4d03-9580-d46cae703a27 tempest-VolumesImageMetadata-878954286 None] Acquiring lock "cinder-quobyte-51920d30-2422-4921-9428-0f592176c398" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-099a02cb-4e71-4d03-9580-d46cae703a27 tempest-VolumesImageMetadata-878954286 None] Lock "cinder-quobyte-51920d30-2422-4921-9428-0f592176c398" acquired by "delete_volume" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e3ce63-4ab3-4d82-87fe-0b908e1c210e]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-099a02cb-4e71-4d03-9580-d46cae703a27 tempest-VolumesImageMetadata-878954286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51920d30-2422-4921-9428-0f592176c398 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:13 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb 1G" returned: 0 in 0.670s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22603519-e4c6-4db4-9066-3fc27a01c864 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:13 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22603519-e4c6-4db4-9066-3fc27a01c864 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb Jul 22 12:16:13 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:13 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51920d30-2422-4921-9428-0f592176c398 Jul 22 12:16:13 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:13 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-099a02cb-4e71-4d03-9580-d46cae703a27 tempest-VolumesImageMetadata-878954286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51920d30-2422-4921-9428-0f592176c398" returned: 0 in 0.434s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-099a02cb-4e71-4d03-9580-d46cae703a27 tempest-VolumesImageMetadata-878954286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51920d30-2422-4921-9428-0f592176c398 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:13 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22603519-e4c6-4db4-9066-3fc27a01c864 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb" returned: 0 in 0.381s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:13 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb is being set with open permissions: ugo+rw Jul 22 12:16:13 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51920d30-2422-4921-9428-0f592176c398 Jul 22 12:16:13 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:13 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb Jul 22 12:16:13 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Flow 'volume_create_manager' (0f9bcdc2-dfaf-4286-90f3-5f70d5f3533e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:13 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e210e8-fecb-4836-aeb2-c790488d649a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-099a02cb-4e71-4d03-9580-d46cae703a27 tempest-VolumesImageMetadata-878954286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-51920d30-2422-4921-9428-0f592176c398" returned: 0 in 0.388s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:13 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-099a02cb-4e71-4d03-9580-d46cae703a27 tempest-VolumesImageMetadata-878954286 None] Lock "cinder-quobyte-51920d30-2422-4921-9428-0f592176c398" released by "delete_volume" :: held 0.902s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb" returned: 0 in 0.377s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e210e8-fecb-4836-aeb2-c790488d649a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1225741812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35240488-db02-4505-803b-e77156506484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03527ce37d045cfb4aab87ab7dc66e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:14Z,use_quota=True,user_id='11791b64dca44069b22ec83015edf720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b660c3d-c458-4a3b-99c4-993ae6c5f339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b660c3d-c458-4a3b-99c4-993ae6c5f339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b2cb4a-5a5b-48a1-bddc-bae01a9d54c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b2cb4a-5a5b-48a1-bddc-bae01a9d54c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35240488-db02-4505-803b-e77156506484', 'volume_name': 'volume-35240488-db02-4505-803b-e77156506484', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ebf8eb-113a-435a-b377-789bd5b24812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ebf8eb-113a-435a-b377-789bd5b24812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed9deee-ffc4-4e8a-a75b-5e32ca12fdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:13 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Volume 35240488-db02-4505-803b-e77156506484: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35240488-db02-4505-803b-e77156506484', 'volume_size': 1} Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:13 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.info Jul 22 12:16:13 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:13 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-099a02cb-4e71-4d03-9580-d46cae703a27 tempest-VolumesImageMetadata-878954286 None] Created reservations ['fd579145-9695-4a2c-9535-8e00cbfadeea', '6745810e-d025-4982-bd21-07f375b68a0f', 'bca6dfc3-007a-46a4-a714-c87752234858', 'c4b7d35d-71d5-48a3-8ec5-b0aa4f5f6ce0'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:16:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-099a02cb-4e71-4d03-9580-d46cae703a27 tempest-VolumesImageMetadata-878954286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-099a02cb-4e71-4d03-9580-d46cae703a27 tempest-VolumesImageMetadata-878954286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-099a02cb-4e71-4d03-9580-d46cae703a27 tempest-VolumesImageMetadata-878954286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-099a02cb-4e71-4d03-9580-d46cae703a27 tempest-VolumesImageMetadata-878954286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-099a02cb-4e71-4d03-9580-d46cae703a27 tempest-VolumesImageMetadata-878954286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-099a02cb-4e71-4d03-9580-d46cae703a27 tempest-VolumesImageMetadata-878954286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:14 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:16:14 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:14 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.info" returned: 0 in 0.281s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:14 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.info is being set with open permissions: ugo+rw Jul 22 12:16:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:14 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.info Jul 22 12:16:14 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:14 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-099a02cb-4e71-4d03-9580-d46cae703a27 tempest-VolumesImageMetadata-878954286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.271s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:14 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-099a02cb-4e71-4d03-9580-d46cae703a27 tempest-VolumesImageMetadata-878954286 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:16:14 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-099a02cb-4e71-4d03-9580-d46cae703a27 tempest-VolumesImageMetadata-878954286 None] Deleted volume successfully. Jul 22 12:16:14 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-099a02cb-4e71-4d03-9580-d46cae703a27 tempest-VolumesImageMetadata-878954286 None] Lock "cinder-51920d30-2422-4921-9428-0f592176c398-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:14 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.info" returned: 0 in 0.277s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:14 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Acquiring lock "cinder-quobyte-be7b624e-d679-4c5f-a98b-b57f406efa79" by "_copy_volume_from_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:14 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Lock "cinder-quobyte-be7b624e-d679-4c5f-a98b-b57f406efa79" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] snapshot: 1919cca1-5313-4377-9471-a66cc925e7cb, volume: be7b624e-d679-4c5f-a98b-b57f406efa79, {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 12:16:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:14 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e03fa79-902a-4488-9212-a69f67b100c8]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:14 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb Jul 22 12:16:14 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:15 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb" returned: 0 in 0.429s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:15 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22603519-e4c6-4db4-9066-3fc27a01c864(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:16:15 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] will copy from snapshot at /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864 {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 12:16:15 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Creating direct copy from snapshot {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 12:16:15 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f386e30a-5e13-4287-9f99-1b6575644ea3]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:15 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864 Jul 22 12:16:15 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:15 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864" returned: 0 in 0.419s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:15 devstack cinder-volume[87568]: DEBUG cinder.utils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Path /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-be7b624e-d679-4c5f-a98b-b57f406efa79 not found in is_blk_device check {{(pid=87568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 12:16:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-be7b624e-d679-4c5f-a98b-b57f406efa79 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:15 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-be7b624e-d679-4c5f-a98b-b57f406efa79 Jul 22 12:16:15 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:21 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-be7b624e-d679-4c5f-a98b-b57f406efa79" returned: 0 in 5.644s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:21 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[06eeb5ae-5bef-4da9-be07-e55f83d9e522]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:21 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864 Jul 22 12:16:21 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:21 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864" returned: 0 in 0.589s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:21 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Image conversion details: src /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-be7b624e-d679-4c5f-a98b-b57f406efa79 {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:16:21 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Converted 1024.00 MB image at 181.39 MB/s Jul 22 12:16:21 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-be7b624e-d679-4c5f-a98b-b57f406efa79 is being set with open permissions: ugo+rw Jul 22 12:16:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-be7b624e-d679-4c5f-a98b-b57f406efa79 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:21 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-be7b624e-d679-4c5f-a98b-b57f406efa79 Jul 22 12:16:21 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:22 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-be7b624e-d679-4c5f-a98b-b57f406efa79" returned: 0 in 0.302s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Lock "cinder-quobyte-be7b624e-d679-4c5f-a98b-b57f406efa79" released by "_copy_volume_from_snapshot" :: held 7.483s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Acquiring lock "cinder-quobyte-1919cca1-5313-4377-9471-a66cc925e7cb" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Lock "cinder-quobyte-1919cca1-5313-4377-9471-a66cc925e7cb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Deleting offline snapshot 1919cca1-5313-4377-9471-a66cc925e7cb of volume 22603519-e4c6-4db4-9066-3fc27a01c864 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] snapshot_file for this snap is: volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc1bb25-91ef-44e2-bcf7-96112e7a4d0b]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:22 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb Jul 22 12:16:22 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:22 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb" returned: 0 in 0.420s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22603519-e4c6-4db4-9066-3fc27a01c864(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b90ccfb-b10b-4a02-8f17-67d132202e39]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:22 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864 Jul 22 12:16:22 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Flow 'volume_create_manager' (b373dc74-007f-4a52-beac-032bfb4ee306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c75f12e-cc9e-4f1d-9ec0-c458afe31eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c75f12e-cc9e-4f1d-9ec0-c458afe31eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1692135897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1fc607b-d9bb-4994-bce9-3a70067b9806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5c9cc030e44a149e1818f7d83d1e92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:23Z,use_quota=True,user_id='299c892f5e2443608ce612fae5dbeea8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48cf22e-4882-4190-875d-555f723230ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48cf22e-4882-4190-875d-555f723230ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f980350-c81c-4498-92ba-5c4c2999da5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f980350-c81c-4498-92ba-5c4c2999da5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1fc607b-d9bb-4994-bce9-3a70067b9806', 'volume_name': 'volume-f1fc607b-d9bb-4994-bce9-3a70067b9806', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (943c4f20-4b37-4ff8-b9dc-a21f5353bf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (943c4f20-4b37-4ff8-b9dc-a21f5353bf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adbcc782-9730-49de-ae91-04f7bd9a97fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:22 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Volume f1fc607b-d9bb-4994-bce9-3a70067b9806: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1fc607b-d9bb-4994-bce9-3a70067b9806', 'volume_size': 1} Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:22 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864" returned: 0 in 0.377s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:22 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb Jul 22 12:16:22 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:23 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb" returned: 0 in 0.346s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:23 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb Jul 22 12:16:23 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:23 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864.1919cca1-5313-4377-9471-a66cc925e7cb" returned: 0 in 0.250s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Lock "cinder-quobyte-1919cca1-5313-4377-9471-a66cc925e7cb" released by "_delete_snapshot" :: held 1.518s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.771s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.693s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1225741812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35240488-db02-4505-803b-e77156506484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03527ce37d045cfb4aab87ab7dc66e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:14Z,use_quota=True,user_id='11791b64dca44069b22ec83015edf720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:16:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Creating volume 35240488-db02-4505-803b-e77156506484 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:16:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:16:23 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:16:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:23 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484 1073741824 Jul 22 12:16:23 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bdd2d0f-2bab-43c7-966f-26a4b911d8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be7b624e-d679-4c5f-a98b-b57f406efa79', 'volume_size': 2, 'source_volid': '22603519-e4c6-4db4-9066-3fc27a01c864', 'source_volstatus': 'available'}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (297c10f4-586a-49b8-9bee-3254b3f4bae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:23 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Volume volume-be7b624e-d679-4c5f-a98b-b57f406efa79 (be7b624e-d679-4c5f-a98b-b57f406efa79): created successfully Jul 22 12:16:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (297c10f4-586a-49b8-9bee-3254b3f4bae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Flow 'volume_create_manager' (ccf09090-91af-4e02-9849-12fecb5c7fed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:23 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-ebbdac07-2121-46cb-9c44-1a56bb13252a tempest-VolumesCloneTest-716414601 None] Created volume successfully. Jul 22 12:16:24 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484 1073741824" returned: 0 in 0.491s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:24 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484 Jul 22 12:16:24 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:24 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484" returned: 0 in 0.270s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.602s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1692135897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1fc607b-d9bb-4994-bce9-3a70067b9806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5c9cc030e44a149e1818f7d83d1e92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:23Z,use_quota=True,user_id='299c892f5e2443608ce612fae5dbeea8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Creating volume f1fc607b-d9bb-4994-bce9-3a70067b9806 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:24 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:16:24 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:16:24 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1fc607b-d9bb-4994-bce9-3a70067b9806 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed9deee-ffc4-4e8a-a75b-5e32ca12fdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35240488-db02-4505-803b-e77156506484', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce425a61-62f0-44ae-be62-23553d53017a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:24 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1fc607b-d9bb-4994-bce9-3a70067b9806 1073741824 Jul 22 12:16:24 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:24 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Volume volume-35240488-db02-4505-803b-e77156506484 (35240488-db02-4505-803b-e77156506484): created successfully Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce425a61-62f0-44ae-be62-23553d53017a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Flow 'volume_create_manager' (0f9bcdc2-dfaf-4286-90f3-5f70d5f3533e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:24 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b92d38d7-9b1b-404a-a919-6c51b4bb6c86 tempest-VolumesDeleteCascade-63650561 None] Created volume successfully. Jul 22 12:16:24 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.259s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread count: 28 {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread info: [<_MainThread(MainThread, started 137793405739136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:16:24 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1fc607b-d9bb-4994-bce9-3a70067b9806 1073741824" returned: 0 in 0.513s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1fc607b-d9bb-4994-bce9-3a70067b9806 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:25 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1fc607b-d9bb-4994-bce9-3a70067b9806 Jul 22 12:16:25 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5f8cec1a-ffae-4d57-b0a3-69710a4d3324 tempest-VolumesCloneTest-716414601 None] Acquiring lock "cinder-be7b624e-d679-4c5f-a98b-b57f406efa79-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5f8cec1a-ffae-4d57-b0a3-69710a4d3324 tempest-VolumesCloneTest-716414601 None] Lock "cinder-be7b624e-d679-4c5f-a98b-b57f406efa79-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Flow 'volume_create_manager' (cf6b97ac-0c31-4ede-8fc7-133c0b1971ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc362ace-c6d0-450e-8b00-53c73c8f6f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5f8cec1a-ffae-4d57-b0a3-69710a4d3324 tempest-VolumesCloneTest-716414601 None] Acquiring lock "cinder-quobyte-be7b624e-d679-4c5f-a98b-b57f406efa79" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc362ace-c6d0-450e-8b00-53c73c8f6f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1980104582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7907594-edf5-4a50-add0-b5f0b6c5e29f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85a8a673970492491ebeadfb0dfce7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:25Z,use_quota=True,user_id='ec2825414e794fc7961593f4ce833589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a12a2427-dbd4-47a2-8294-165aef284a86),volume_type_id=a12a2427-dbd4-47a2-8294-165aef284a86)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aae028c1-5cb3-47b2-8136-51ac8ba219f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aae028c1-5cb3-47b2-8136-51ac8ba219f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ab03c5-c56f-4816-b576-8510d8f81142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ab03c5-c56f-4816-b576-8510d8f81142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7907594-edf5-4a50-add0-b5f0b6c5e29f', 'volume_name': 'volume-a7907594-edf5-4a50-add0-b5f0b6c5e29f', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afa13a1d-778d-4d86-90ca-824efec5e03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afa13a1d-778d-4d86-90ca-824efec5e03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca1a5997-cfe3-4889-a604-42b82d585014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:25 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Volume a7907594-edf5-4a50-add0-b5f0b6c5e29f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7907594-edf5-4a50-add0-b5f0b6c5e29f', 'volume_size': 1} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5f8cec1a-ffae-4d57-b0a3-69710a4d3324 tempest-VolumesCloneTest-716414601 None] Lock "cinder-quobyte-be7b624e-d679-4c5f-a98b-b57f406efa79" acquired by "delete_volume" :: waited 0.068s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[54386ad6-fa31-4bb0-b5fa-fa272199cd34]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5f8cec1a-ffae-4d57-b0a3-69710a4d3324 tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-be7b624e-d679-4c5f-a98b-b57f406efa79 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-43eca9de-e92f-4694-8955-1d38b427f4b1 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:25 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1fc607b-d9bb-4994-bce9-3a70067b9806" returned: 0 in 0.384s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.126s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1980104582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7907594-edf5-4a50-add0-b5f0b6c5e29f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85a8a673970492491ebeadfb0dfce7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:25Z,use_quota=True,user_id='ec2825414e794fc7961593f4ce833589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a12a2427-dbd4-47a2-8294-165aef284a86),volume_type_id=a12a2427-dbd4-47a2-8294-165aef284a86)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Creating volume a7907594-edf5-4a50-add0-b5f0b6c5e29f {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:16:25 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7907594-edf5-4a50-add0-b5f0b6c5e29f 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adbcc782-9730-49de-ae91-04f7bd9a97fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1fc607b-d9bb-4994-bce9-3a70067b9806', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:25 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-be7b624e-d679-4c5f-a98b-b57f406efa79 Jul 22 12:16:25 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff539cd5-e5da-4047-b674-c66ef79d4b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:25 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7907594-edf5-4a50-add0-b5f0b6c5e29f 1073741824 Jul 22 12:16:25 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:25 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Volume volume-f1fc607b-d9bb-4994-bce9-3a70067b9806 (f1fc607b-d9bb-4994-bce9-3a70067b9806): created successfully Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff539cd5-e5da-4047-b674-c66ef79d4b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Flow 'volume_create_manager' (b373dc74-007f-4a52-beac-032bfb4ee306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:25 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-a5817dca-08ec-42c9-ba0e-ce551c9804b4 tempest-AbsoluteLimitsTests-1599014272 None] Created volume successfully. Jul 22 12:16:25 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5f8cec1a-ffae-4d57-b0a3-69710a4d3324 tempest-VolumesCloneTest-716414601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-be7b624e-d679-4c5f-a98b-b57f406efa79" returned: 0 in 0.373s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5f8cec1a-ffae-4d57-b0a3-69710a4d3324 tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-be7b624e-d679-4c5f-a98b-b57f406efa79 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:25 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-be7b624e-d679-4c5f-a98b-b57f406efa79 Jul 22 12:16:25 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:25 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7907594-edf5-4a50-add0-b5f0b6c5e29f 1073741824" returned: 0 in 0.500s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7907594-edf5-4a50-add0-b5f0b6c5e29f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:25 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5f8cec1a-ffae-4d57-b0a3-69710a4d3324 tempest-VolumesCloneTest-716414601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-be7b624e-d679-4c5f-a98b-b57f406efa79" returned: 0 in 0.273s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:25 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7907594-edf5-4a50-add0-b5f0b6c5e29f Jul 22 12:16:25 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:25 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5f8cec1a-ffae-4d57-b0a3-69710a4d3324 tempest-VolumesCloneTest-716414601 None] Lock "cinder-quobyte-be7b624e-d679-4c5f-a98b-b57f406efa79" released by "delete_volume" :: held 0.715s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-c9d0a97e-2488-4960-887d-7991105022e7 tempest-AbsoluteLimitsTests-1599014272 None] Acquiring lock "cinder-f1fc607b-d9bb-4994-bce9-3a70067b9806-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-c9d0a97e-2488-4960-887d-7991105022e7 tempest-AbsoluteLimitsTests-1599014272 None] Lock "cinder-f1fc607b-d9bb-4994-bce9-3a70067b9806-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-5f8cec1a-ffae-4d57-b0a3-69710a4d3324 tempest-VolumesCloneTest-716414601 None] Created reservations ['3602ffe2-3017-438d-bdd8-b36a2a78dfa0', '6921b57d-5bf7-4992-85ae-57ac7a36c726', 'ce5bba40-27b9-4d1b-9c9c-4756e8b3a07c', '85549f67-b87e-4060-837b-95d6811eff43'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-c9d0a97e-2488-4960-887d-7991105022e7 tempest-AbsoluteLimitsTests-1599014272 None] Acquiring lock "cinder-quobyte-f1fc607b-d9bb-4994-bce9-3a70067b9806" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-c9d0a97e-2488-4960-887d-7991105022e7 tempest-AbsoluteLimitsTests-1599014272 None] Lock "cinder-quobyte-f1fc607b-d9bb-4994-bce9-3a70067b9806" acquired by "delete_volume" :: waited 0.028s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5f8cec1a-ffae-4d57-b0a3-69710a4d3324 tempest-VolumesCloneTest-716414601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5f8cec1a-ffae-4d57-b0a3-69710a4d3324 tempest-VolumesCloneTest-716414601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5f8cec1a-ffae-4d57-b0a3-69710a4d3324 tempest-VolumesCloneTest-716414601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5f8cec1a-ffae-4d57-b0a3-69710a4d3324 tempest-VolumesCloneTest-716414601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5f8cec1a-ffae-4d57-b0a3-69710a4d3324 tempest-VolumesCloneTest-716414601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5f8cec1a-ffae-4d57-b0a3-69710a4d3324 tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee07082-5c18-469a-956f-4f2ba38307bb]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c9d0a97e-2488-4960-887d-7991105022e7 tempest-AbsoluteLimitsTests-1599014272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1fc607b-d9bb-4994-bce9-3a70067b9806 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:26 devstack sudo[96528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:16:26 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:26 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7907594-edf5-4a50-add0-b5f0b6c5e29f" returned: 0 in 0.320s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-43eca9de-e92f-4694-8955-1d38b427f4b1 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.913s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca1a5997-cfe3-4889-a604-42b82d585014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7907594-edf5-4a50-add0-b5f0b6c5e29f', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46c5b0a-9ca5-495d-aa32-f986533460d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-43eca9de-e92f-4694-8955-1d38b427f4b1 tempest-VolumesDeleteCascade-63650561 None] Creating offline snapshot 505bd9f2-9a73-491d-95fa-2ba612b64fbe of volume 35240488-db02-4505-803b-e77156506484 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:16:26 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Volume volume-a7907594-edf5-4a50-add0-b5f0b6c5e29f (a7907594-edf5-4a50-add0-b5f0b6c5e29f): created successfully Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46c5b0a-9ca5-495d-aa32-f986533460d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Flow 'volume_create_manager' (cf6b97ac-0c31-4ede-8fc7-133c0b1971ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:26 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1fc607b-d9bb-4994-bce9-3a70067b9806 Jul 22 12:16:26 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8e0b56a6-952d-4907-94a6-6a574e5f2b86 tempest-VolumesCloneTest-716414601 None] Acquiring lock "cinder-22603519-e4c6-4db4-9066-3fc27a01c864-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b267f6c6-763c-4a00-8474-8daba46b1959]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-43eca9de-e92f-4694-8955-1d38b427f4b1 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:26 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-63e377d2-f331-4e8f-9047-404889d8ffa1 tempest-VolumeTypesAccessTest-733055703 None] Created volume successfully. Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8e0b56a6-952d-4907-94a6-6a574e5f2b86 tempest-VolumesCloneTest-716414601 None] Lock "cinder-22603519-e4c6-4db4-9066-3fc27a01c864-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8e0b56a6-952d-4907-94a6-6a574e5f2b86 tempest-VolumesCloneTest-716414601 None] Acquiring lock "cinder-quobyte-22603519-e4c6-4db4-9066-3fc27a01c864" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:26 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484 Jul 22 12:16:26 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8e0b56a6-952d-4907-94a6-6a574e5f2b86 tempest-VolumesCloneTest-716414601 None] Lock "cinder-quobyte-22603519-e4c6-4db4-9066-3fc27a01c864" acquired by "delete_volume" :: waited 0.023s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:26 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5f8cec1a-ffae-4d57-b0a3-69710a4d3324 tempest-VolumesCloneTest-716414601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.353s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-5f8cec1a-ffae-4d57-b0a3-69710a4d3324 tempest-VolumesCloneTest-716414601 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec8a914-6a87-4c3b-8bcd-8ef12961e412]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8e0b56a6-952d-4907-94a6-6a574e5f2b86 tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:26 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-5f8cec1a-ffae-4d57-b0a3-69710a4d3324 tempest-VolumesCloneTest-716414601 None] Deleted volume successfully. Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5f8cec1a-ffae-4d57-b0a3-69710a4d3324 tempest-VolumesCloneTest-716414601 None] Lock "cinder-be7b624e-d679-4c5f-a98b-b57f406efa79-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:26 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c9d0a97e-2488-4960-887d-7991105022e7 tempest-AbsoluteLimitsTests-1599014272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1fc607b-d9bb-4994-bce9-3a70067b9806" returned: 0 in 0.460s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c9d0a97e-2488-4960-887d-7991105022e7 tempest-AbsoluteLimitsTests-1599014272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1fc607b-d9bb-4994-bce9-3a70067b9806 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:26 devstack sudo[96536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864 Jul 22 12:16:26 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:26 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1fc607b-d9bb-4994-bce9-3a70067b9806 Jul 22 12:16:26 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:26 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-43eca9de-e92f-4694-8955-1d38b427f4b1 tempest-VolumesDeleteCascade-63650561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484" returned: 0 in 0.434s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-43eca9de-e92f-4694-8955-1d38b427f4b1 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:26 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe 1G Jul 22 12:16:26 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:26 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c9d0a97e-2488-4960-887d-7991105022e7 tempest-AbsoluteLimitsTests-1599014272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1fc607b-d9bb-4994-bce9-3a70067b9806" returned: 0 in 0.290s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:26 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8e0b56a6-952d-4907-94a6-6a574e5f2b86 tempest-VolumesCloneTest-716414601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864" returned: 0 in 0.416s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8e0b56a6-952d-4907-94a6-6a574e5f2b86 tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-c9d0a97e-2488-4960-887d-7991105022e7 tempest-AbsoluteLimitsTests-1599014272 None] Lock "cinder-quobyte-f1fc607b-d9bb-4994-bce9-3a70067b9806" released by "delete_volume" :: held 0.835s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:26 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864 Jul 22 12:16:26 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-c9d0a97e-2488-4960-887d-7991105022e7 tempest-AbsoluteLimitsTests-1599014272 None] Created reservations ['56667597-e8af-4b7a-a8b0-6f00f0a9d0e1', '2760864c-a8e5-4f0d-88dd-816cc7da5a58', '39770ce6-f986-4e27-9d67-bd92c516f284', 'ecb27dba-8d1e-494a-a5a3-7c38af72a2cc'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c9d0a97e-2488-4960-887d-7991105022e7 tempest-AbsoluteLimitsTests-1599014272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c9d0a97e-2488-4960-887d-7991105022e7 tempest-AbsoluteLimitsTests-1599014272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-c9d0a97e-2488-4960-887d-7991105022e7 tempest-AbsoluteLimitsTests-1599014272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-c9d0a97e-2488-4960-887d-7991105022e7 tempest-AbsoluteLimitsTests-1599014272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c9d0a97e-2488-4960-887d-7991105022e7 tempest-AbsoluteLimitsTests-1599014272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c9d0a97e-2488-4960-887d-7991105022e7 tempest-AbsoluteLimitsTests-1599014272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:27 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:16:27 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-459895a3-beae-4c0f-a367-ef1862622207 tempest-VolumeTypesAccessTest-733055703 None] Acquiring lock "cinder-a7907594-edf5-4a50-add0-b5f0b6c5e29f-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:27 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8e0b56a6-952d-4907-94a6-6a574e5f2b86 tempest-VolumesCloneTest-716414601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-22603519-e4c6-4db4-9066-3fc27a01c864" returned: 0 in 0.329s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-459895a3-beae-4c0f-a367-ef1862622207 tempest-VolumeTypesAccessTest-733055703 None] Lock "cinder-a7907594-edf5-4a50-add0-b5f0b6c5e29f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8e0b56a6-952d-4907-94a6-6a574e5f2b86 tempest-VolumesCloneTest-716414601 None] Lock "cinder-quobyte-22603519-e4c6-4db4-9066-3fc27a01c864" released by "delete_volume" :: held 0.837s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:27 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-43eca9de-e92f-4694-8955-1d38b427f4b1 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe 1G" returned: 0 in 0.554s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-43eca9de-e92f-4694-8955-1d38b427f4b1 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35240488-db02-4505-803b-e77156506484 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:27 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35240488-db02-4505-803b-e77156506484 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe Jul 22 12:16:27 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-459895a3-beae-4c0f-a367-ef1862622207 tempest-VolumeTypesAccessTest-733055703 None] Acquiring lock "cinder-quobyte-a7907594-edf5-4a50-add0-b5f0b6c5e29f" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-459895a3-beae-4c0f-a367-ef1862622207 tempest-VolumeTypesAccessTest-733055703 None] Lock "cinder-quobyte-a7907594-edf5-4a50-add0-b5f0b6c5e29f" acquired by "delete_volume" :: waited 0.026s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-8e0b56a6-952d-4907-94a6-6a574e5f2b86 tempest-VolumesCloneTest-716414601 None] Created reservations ['44e9a38b-daa7-41fe-8405-c4f2ece876fc', 'c251640f-5738-48b2-8ca7-d197bf2d56d1', '9067e086-0c75-494f-b291-b4526f66642d', '648b9915-d129-4ebc-a28e-2b45025ebd26'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[3191b162-bcf1-442e-849d-32d9841a333f]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-459895a3-beae-4c0f-a367-ef1862622207 tempest-VolumeTypesAccessTest-733055703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7907594-edf5-4a50-add0-b5f0b6c5e29f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:27 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c9d0a97e-2488-4960-887d-7991105022e7 tempest-AbsoluteLimitsTests-1599014272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.476s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-c9d0a97e-2488-4960-887d-7991105022e7 tempest-AbsoluteLimitsTests-1599014272 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:16:27 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-c9d0a97e-2488-4960-887d-7991105022e7 tempest-AbsoluteLimitsTests-1599014272 None] Deleted volume successfully. Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8e0b56a6-952d-4907-94a6-6a574e5f2b86 tempest-VolumesCloneTest-716414601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8e0b56a6-952d-4907-94a6-6a574e5f2b86 tempest-VolumesCloneTest-716414601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8e0b56a6-952d-4907-94a6-6a574e5f2b86 tempest-VolumesCloneTest-716414601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:27 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7907594-edf5-4a50-add0-b5f0b6c5e29f Jul 22 12:16:27 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8e0b56a6-952d-4907-94a6-6a574e5f2b86 tempest-VolumesCloneTest-716414601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8e0b56a6-952d-4907-94a6-6a574e5f2b86 tempest-VolumesCloneTest-716414601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8e0b56a6-952d-4907-94a6-6a574e5f2b86 tempest-VolumesCloneTest-716414601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-c9d0a97e-2488-4960-887d-7991105022e7 tempest-AbsoluteLimitsTests-1599014272 None] Lock "cinder-f1fc607b-d9bb-4994-bce9-3a70067b9806-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:27 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:16:27 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:27 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-43eca9de-e92f-4694-8955-1d38b427f4b1 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35240488-db02-4505-803b-e77156506484 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe" returned: 0 in 0.404s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:27 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-43eca9de-e92f-4694-8955-1d38b427f4b1 tempest-VolumesDeleteCascade-63650561 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe is being set with open permissions: ugo+rw Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-43eca9de-e92f-4694-8955-1d38b427f4b1 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:27 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe Jul 22 12:16:27 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:27 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8e0b56a6-952d-4907-94a6-6a574e5f2b86 tempest-VolumesCloneTest-716414601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.283s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-8e0b56a6-952d-4907-94a6-6a574e5f2b86 tempest-VolumesCloneTest-716414601 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:16:27 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-8e0b56a6-952d-4907-94a6-6a574e5f2b86 tempest-VolumesCloneTest-716414601 None] Deleted volume successfully. Jul 22 12:16:27 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-459895a3-beae-4c0f-a367-ef1862622207 tempest-VolumeTypesAccessTest-733055703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7907594-edf5-4a50-add0-b5f0b6c5e29f" returned: 0 in 0.515s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-459895a3-beae-4c0f-a367-ef1862622207 tempest-VolumeTypesAccessTest-733055703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7907594-edf5-4a50-add0-b5f0b6c5e29f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8e0b56a6-952d-4907-94a6-6a574e5f2b86 tempest-VolumesCloneTest-716414601 None] Lock "cinder-22603519-e4c6-4db4-9066-3fc27a01c864-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:28 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7907594-edf5-4a50-add0-b5f0b6c5e29f Jul 22 12:16:28 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:28 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-43eca9de-e92f-4694-8955-1d38b427f4b1 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe" returned: 0 in 0.306s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-43eca9de-e92f-4694-8955-1d38b427f4b1 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:28 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.info Jul 22 12:16:28 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:28 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-459895a3-beae-4c0f-a367-ef1862622207 tempest-VolumeTypesAccessTest-733055703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a7907594-edf5-4a50-add0-b5f0b6c5e29f" returned: 0 in 0.280s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-459895a3-beae-4c0f-a367-ef1862622207 tempest-VolumeTypesAccessTest-733055703 None] Lock "cinder-quobyte-a7907594-edf5-4a50-add0-b5f0b6c5e29f" released by "delete_volume" :: held 0.864s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:28 devstack cinder-volume[87568]: WARNING cinder.quota [None req-459895a3-beae-4c0f-a367-ef1862622207 tempest-VolumeTypesAccessTest-733055703 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1921663078 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1921663078, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:16:28 devstack cinder-volume[87568]: WARNING cinder.quota [None req-459895a3-beae-4c0f-a367-ef1862622207 tempest-VolumeTypesAccessTest-733055703 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1921663078 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1921663078, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:16:28 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-459895a3-beae-4c0f-a367-ef1862622207 tempest-VolumeTypesAccessTest-733055703 None] Created reservations ['0bd2c502-87e0-43e8-91df-2f8a4043b405', '7674b65a-92ec-4279-88a0-d9693320bbcb', '3c92c4fa-8d24-446c-bb22-f536da9be2b9', 'dbcd77a9-cf60-4436-9ad7-4c02807419b0'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:16:28 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-43eca9de-e92f-4694-8955-1d38b427f4b1 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.info" returned: 0 in 0.281s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:28 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-43eca9de-e92f-4694-8955-1d38b427f4b1 tempest-VolumesDeleteCascade-63650561 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.info is being set with open permissions: ugo+rw Jul 22 12:16:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-43eca9de-e92f-4694-8955-1d38b427f4b1 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:28 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.info Jul 22 12:16:28 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-459895a3-beae-4c0f-a367-ef1862622207 tempest-VolumeTypesAccessTest-733055703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-459895a3-beae-4c0f-a367-ef1862622207 tempest-VolumeTypesAccessTest-733055703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-459895a3-beae-4c0f-a367-ef1862622207 tempest-VolumeTypesAccessTest-733055703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-459895a3-beae-4c0f-a367-ef1862622207 tempest-VolumeTypesAccessTest-733055703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-459895a3-beae-4c0f-a367-ef1862622207 tempest-VolumeTypesAccessTest-733055703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-459895a3-beae-4c0f-a367-ef1862622207 tempest-VolumeTypesAccessTest-733055703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:28 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:16:28 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:28 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-43eca9de-e92f-4694-8955-1d38b427f4b1 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.info" returned: 0 in 0.420s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-43eca9de-e92f-4694-8955-1d38b427f4b1 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.559s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:28 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-459895a3-beae-4c0f-a367-ef1862622207 tempest-VolumeTypesAccessTest-733055703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.406s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:28 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-459895a3-beae-4c0f-a367-ef1862622207 tempest-VolumeTypesAccessTest-733055703 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:16:28 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-459895a3-beae-4c0f-a367-ef1862622207 tempest-VolumeTypesAccessTest-733055703 None] Deleted volume successfully. Jul 22 12:16:28 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-43eca9de-e92f-4694-8955-1d38b427f4b1 tempest-VolumesDeleteCascade-63650561 None] Create snapshot completed successfully Jul 22 12:16:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-459895a3-beae-4c0f-a367-ef1862622207 tempest-VolumeTypesAccessTest-733055703 None] Lock "cinder-a7907594-edf5-4a50-add0-b5f0b6c5e29f-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-db9d3696-f5a8-4345-bf1e-d28bc8ea6184 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-db9d3696-f5a8-4345-bf1e-d28bc8ea6184 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-db9d3696-f5a8-4345-bf1e-d28bc8ea6184 tempest-VolumesDeleteCascade-63650561 None] Creating offline snapshot 28bef375-ce7d-4a91-a08d-6a3d73584b4a of volume 35240488-db02-4505-803b-e77156506484 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:16:29 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[9384246c-8444-43ef-b49d-20c84a7b3f88]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-db9d3696-f5a8-4345-bf1e-d28bc8ea6184 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:30 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe Jul 22 12:16:30 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:30 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-db9d3696-f5a8-4345-bf1e-d28bc8ea6184 tempest-VolumesDeleteCascade-63650561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe" returned: 0 in 0.492s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-db9d3696-f5a8-4345-bf1e-d28bc8ea6184 tempest-VolumesDeleteCascade-63650561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35240488-db02-4505-803b-e77156506484(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:16:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-db9d3696-f5a8-4345-bf1e-d28bc8ea6184 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.28bef375-ce7d-4a91-a08d-6a3d73584b4a 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:30 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.28bef375-ce7d-4a91-a08d-6a3d73584b4a 1G Jul 22 12:16:30 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:31 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-db9d3696-f5a8-4345-bf1e-d28bc8ea6184 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.28bef375-ce7d-4a91-a08d-6a3d73584b4a 1G" returned: 0 in 0.625s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-db9d3696-f5a8-4345-bf1e-d28bc8ea6184 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.28bef375-ce7d-4a91-a08d-6a3d73584b4a {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:31 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.28bef375-ce7d-4a91-a08d-6a3d73584b4a Jul 22 12:16:31 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:31 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-db9d3696-f5a8-4345-bf1e-d28bc8ea6184 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.28bef375-ce7d-4a91-a08d-6a3d73584b4a" returned: 0 in 0.388s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:31 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-db9d3696-f5a8-4345-bf1e-d28bc8ea6184 tempest-VolumesDeleteCascade-63650561 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.28bef375-ce7d-4a91-a08d-6a3d73584b4a is being set with open permissions: ugo+rw Jul 22 12:16:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-db9d3696-f5a8-4345-bf1e-d28bc8ea6184 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.28bef375-ce7d-4a91-a08d-6a3d73584b4a {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:31 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.28bef375-ce7d-4a91-a08d-6a3d73584b4a Jul 22 12:16:31 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:31 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-db9d3696-f5a8-4345-bf1e-d28bc8ea6184 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.28bef375-ce7d-4a91-a08d-6a3d73584b4a" returned: 0 in 0.326s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-db9d3696-f5a8-4345-bf1e-d28bc8ea6184 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.032s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:31 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-db9d3696-f5a8-4345-bf1e-d28bc8ea6184 tempest-VolumesDeleteCascade-63650561 None] Create snapshot completed successfully Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Flow 'volume_create_manager' (cc5b7d81-cd30-4b36-a6c8-a27a6995177e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13af5be4-d542-4aa7-9c1e-883cbf5d813e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "cinder-35240488-db02-4505-803b-e77156506484-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13af5be4-d542-4aa7-9c1e-883cbf5d813e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-897378528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a74a959-c3b1-43e9-970b-2360c464bbb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ccb57653264f1cb344f4789aa630c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:33Z,use_quota=True,user_id='eb0a42d668bc4580abd94d74fb1c56c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d2b216-817b-45fd-bc8f-bf2b9d1b83d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d2b216-817b-45fd-bc8f-bf2b9d1b83d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d8fa97-d8c0-4c4a-ade8-b1cb7d536b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d8fa97-d8c0-4c4a-ade8-b1cb7d536b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a74a959-c3b1-43e9-970b-2360c464bbb9', 'volume_name': 'volume-5a74a959-c3b1-43e9-970b-2360c464bbb9', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbaa2e5-4005-4452-a4f6-90780691d173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbaa2e5-4005-4452-a4f6-90780691d173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40546f6b-a27a-4b82-b9cf-5c65bd72f9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:33 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Volume 5a74a959-c3b1-43e9-970b-2360c464bbb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a74a959-c3b1-43e9-970b-2360c464bbb9', 'volume_size': 1} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-897378528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a74a959-c3b1-43e9-970b-2360c464bbb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ccb57653264f1cb344f4789aa630c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:33Z,use_quota=True,user_id='eb0a42d668bc4580abd94d74fb1c56c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Creating volume 5a74a959-c3b1-43e9-970b-2360c464bbb9 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:16:33 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5a74a959-c3b1-43e9-970b-2360c464bbb9 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-35240488-db02-4505-803b-e77156506484-delete_volume" acquired by "delete_volume" :: waited 0.145s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:33 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5a74a959-c3b1-43e9-970b-2360c464bbb9 1073741824 Jul 22 12:16:33 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Performing cascade delete. {{(pid=87568) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "cinder-28bef375-ce7d-4a91-a08d-6a3d73584b4a-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-28bef375-ce7d-4a91-a08d-6a3d73584b4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "cinder-quobyte-35240488-db02-4505-803b-e77156506484" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-quobyte-35240488-db02-4505-803b-e77156506484" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "cinder-quobyte-28bef375-ce7d-4a91-a08d-6a3d73584b4a" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Flow 'volume_create_manager' (b4480e5b-9a65-4f1e-8f79-5ead7e624b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0248f528-a05d-43b9-a6b5-85f21404319c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0248f528-a05d-43b9-a6b5-85f21404319c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-135267543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc415ec6-b994-460c-ab3c-c486c1e2795b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5e352de52742e7b8dd4ed44b45ed83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:33Z,use_quota=True,user_id='800e0dab3c2c4553ad7bc1862d60d500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb011f7-41fa-4cc9-9115-38fabb605482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb011f7-41fa-4cc9-9115-38fabb605482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b7cccf-5861-4fcb-8bd8-8a3bd7a1bf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.image.glance [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Creating Keystone auth plugin from conf {{(pid=87568) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-quobyte-28bef375-ce7d-4a91-a08d-6a3d73584b4a" acquired by "_delete_snapshot" :: waited 0.093s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Deleting offline snapshot 28bef375-ce7d-4a91-a08d-6a3d73584b4a of volume 35240488-db02-4505-803b-e77156506484 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] snapshot_file for this snap is: volume-35240488-db02-4505-803b-e77156506484.28bef375-ce7d-4a91-a08d-6a3d73584b4a {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed728003-ca59-4e83-8c37-78a9083e2fd9]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.28bef375-ce7d-4a91-a08d-6a3d73584b4a {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:33 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.28bef375-ce7d-4a91-a08d-6a3d73584b4a Jul 22 12:16:33 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:33 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5a74a959-c3b1-43e9-970b-2360c464bbb9 1073741824" returned: 0 in 0.578s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5a74a959-c3b1-43e9-970b-2360c464bbb9 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:34 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5a74a959-c3b1-43e9-970b-2360c464bbb9 Jul 22 12:16:34 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b7cccf-5861-4fcb-8bd8-8a3bd7a1bf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fc415ec6-b994-460c-ab3c-c486c1e2795b', 'volume_name': 'volume-fc415ec6-b994-460c-ab3c-c486c1e2795b', 'volume_size': 1, 'image_id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fe02ba8749e04b7eaeb23823f684fdc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'created_at': datetime.datetime(2026, 7, 22, 10, 2, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 2, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7671ffb3-4a97-4ad8-8c11-5fd7d2e54cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7671ffb3-4a97-4ad8-8c11-5fd7d2e54cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ca9bce-5dbc-4267-842b-0d60ac2222f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:34 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Volume fc415ec6-b994-460c-ab3c-c486c1e2795b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fc415ec6-b994-460c-ab3c-c486c1e2795b', 'volume_size': 1, 'image_id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fe02ba8749e04b7eaeb23823f684fdc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'created_at': datetime.datetime(2026, 7, 22, 10, 2, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 2, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Trying to clone fc415ec6-b994-460c-ab3c-c486c1e2795b from image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e at location (None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}]). {{(pid=87568) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 12:16:34 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.28bef375-ce7d-4a91-a08d-6a3d73584b4a" returned: 0 in 0.474s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35240488-db02-4505-803b-e77156506484(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e1bd9f-a74b-4cce-8610-cd155bc8ed47]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:34 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5a74a959-c3b1-43e9-970b-2360c464bbb9" returned: 0 in 0.333s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40546f6b-a27a-4b82-b9cf-5c65bd72f9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a74a959-c3b1-43e9-970b-2360c464bbb9', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cdc4d7c-fcad-430a-b1ee-0198c176811b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:34 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Volume volume-5a74a959-c3b1-43e9-970b-2360c464bbb9 (5a74a959-c3b1-43e9-970b-2360c464bbb9): created successfully Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cdc4d7c-fcad-430a-b1ee-0198c176811b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:34 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe Jul 22 12:16:34 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Flow 'volume_create_manager' (cc5b7d81-cd30-4b36-a6c8-a27a6995177e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:34 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-23e416d6-3926-42f9-8a7e-5e951d5b18f1 tempest-VolumesMetadataTest-975791418 None] Created volume successfully. Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_v6tw695ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 12:16:34 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Image download 20.69 MB at 20.69 MB/s Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89fdb0f-8947-4e9b-a992-581853ce86f1]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_v6tw695ldevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:34 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe" returned: 0 in 0.559s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35240488-db02-4505-803b-e77156506484(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:16:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.28bef375-ce7d-4a91-a08d-6a3d73584b4a {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:34 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.28bef375-ce7d-4a91-a08d-6a3d73584b4a Jul 22 12:16:34 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:34 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_v6tw695ldevstack@QuobyteHD Jul 22 12:16:34 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:35 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_v6tw695ldevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Temporary image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e is fetched for user 800e0dab3c2c4553ad7bc1862d60d500. {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1063fd7f-57b8-41cb-9f86-e7c18d09603d]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_v6tw695ldevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:35 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.28bef375-ce7d-4a91-a08d-6a3d73584b4a" returned: 0 in 0.453s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.28bef375-ce7d-4a91-a08d-6a3d73584b4a {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:35 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.28bef375-ce7d-4a91-a08d-6a3d73584b4a Jul 22 12:16:35 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:35 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_v6tw695ldevstack@QuobyteHD Jul 22 12:16:35 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:35 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.28bef375-ce7d-4a91-a08d-6a3d73584b4a" returned: 0 in 0.320s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-quobyte-28bef375-ce7d-4a91-a08d-6a3d73584b4a" released by "_delete_snapshot" :: held 1.952s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-quobyte-35240488-db02-4505-803b-e77156506484" released by "delete_snapshot" :: held 2.055s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:35 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_v6tw695ldevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-135267543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc415ec6-b994-460c-ab3c-c486c1e2795b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5e352de52742e7b8dd4ed44b45ed83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:33Z,use_quota=True,user_id='800e0dab3c2c4553ad7bc1862d60d500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Creating volume fc415ec6-b994-460c-ab3c-c486c1e2795b {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:16:35 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:35 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b 1073741824 Jul 22 12:16:35 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Created reservations ['ce98c48e-8727-42c4-9182-39be7b565ba9', 'fe08edc7-b615-4429-97ed-e5faf1bf2a49', '563dc943-7786-433e-8667-430d93768bef', 'fc85add1-934d-4321-adf7-6a9edb2be533'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:16:35 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Delete snapshot completed successfully. Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-28bef375-ce7d-4a91-a08d-6a3d73584b4a-delete_snapshot" released by "delete_snapshot" :: held 2.324s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "cinder-505bd9f2-9a73-491d-95fa-2ba612b64fbe-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-505bd9f2-9a73-491d-95fa-2ba612b64fbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "cinder-quobyte-35240488-db02-4505-803b-e77156506484" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-quobyte-35240488-db02-4505-803b-e77156506484" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "cinder-quobyte-505bd9f2-9a73-491d-95fa-2ba612b64fbe" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-quobyte-505bd9f2-9a73-491d-95fa-2ba612b64fbe" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Deleting offline snapshot 505bd9f2-9a73-491d-95fa-2ba612b64fbe of volume 35240488-db02-4505-803b-e77156506484 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] snapshot_file for this snap is: volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[45678aa9-83ef-49db-9588-674b3f37f818]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:36 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe Jul 22 12:16:36 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-225bba16-4c88-4a44-8e8e-274f7ae2b06e tempest-VolumesMetadataTest-975791418 None] Acquiring lock "cinder-5a74a959-c3b1-43e9-970b-2360c464bbb9-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-225bba16-4c88-4a44-8e8e-274f7ae2b06e tempest-VolumesMetadataTest-975791418 None] Lock "cinder-5a74a959-c3b1-43e9-970b-2360c464bbb9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-225bba16-4c88-4a44-8e8e-274f7ae2b06e tempest-VolumesMetadataTest-975791418 None] Acquiring lock "cinder-quobyte-5a74a959-c3b1-43e9-970b-2360c464bbb9" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-225bba16-4c88-4a44-8e8e-274f7ae2b06e tempest-VolumesMetadataTest-975791418 None] Lock "cinder-quobyte-5a74a959-c3b1-43e9-970b-2360c464bbb9" acquired by "delete_volume" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:36 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b 1073741824" returned: 0 in 0.597s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:36 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c84184f-2988-4325-b6d6-2eac56bf4fc9]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-225bba16-4c88-4a44-8e8e-274f7ae2b06e tempest-VolumesMetadataTest-975791418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5a74a959-c3b1-43e9-970b-2360c464bbb9 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:36 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b Jul 22 12:16:36 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:36 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5a74a959-c3b1-43e9-970b-2360c464bbb9 Jul 22 12:16:36 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:36 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe" returned: 0 in 0.489s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35240488-db02-4505-803b-e77156506484(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:16:36 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1084e95d-056d-4d9b-a589-b62dad3d100f]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:36 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484 Jul 22 12:16:36 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:36 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b" returned: 0 in 0.330s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:16:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:36 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Attempting download of 97d73ec3-9d73-4df3-baa6-cc90fa33d35e ((None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}])) to volume fc415ec6-b994-460c-ab3c-c486c1e2795b. {{(pid=87568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 12:16:36 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-225bba16-4c88-4a44-8e8e-274f7ae2b06e tempest-VolumesMetadataTest-975791418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5a74a959-c3b1-43e9-970b-2360c464bbb9" returned: 0 in 0.481s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-225bba16-4c88-4a44-8e8e-274f7ae2b06e tempest-VolumesMetadataTest-975791418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5a74a959-c3b1-43e9-970b-2360c464bbb9 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:36 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ab50c2-6a16-41d7-bf1f-8819dd558bf6]: (4, 'raw') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_15xhay44 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:36 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5a74a959-c3b1-43e9-970b-2360c464bbb9 Jul 22 12:16:36 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:36 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_15xhay44 Jul 22 12:16:36 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:37 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484" returned: 0 in 0.542s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:37 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe Jul 22 12:16:37 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:37 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-225bba16-4c88-4a44-8e8e-274f7ae2b06e tempest-VolumesMetadataTest-975791418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5a74a959-c3b1-43e9-970b-2360c464bbb9" returned: 0 in 0.386s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:37 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_15xhay44" returned: 0 in 0.389s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_15xhay44 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-225bba16-4c88-4a44-8e8e-274f7ae2b06e tempest-VolumesMetadataTest-975791418 None] Lock "cinder-quobyte-5a74a959-c3b1-43e9-970b-2360c464bbb9" released by "delete_volume" :: held 0.950s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-225bba16-4c88-4a44-8e8e-274f7ae2b06e tempest-VolumesMetadataTest-975791418 None] Created reservations ['8f157425-2e2d-4d94-8329-38e99e4c615b', 'e0893161-5538-4040-ad05-b01be2c27ecb', 'f29a5d94-ae5d-46c2-a956-5e2b0f2d0d6a', 'c5c8e0d8-06dd-4331-9907-31a2005543e4'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:16:37 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_15xhay44 Jul 22 12:16:37 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-225bba16-4c88-4a44-8e8e-274f7ae2b06e tempest-VolumesMetadataTest-975791418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-225bba16-4c88-4a44-8e8e-274f7ae2b06e tempest-VolumesMetadataTest-975791418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-225bba16-4c88-4a44-8e8e-274f7ae2b06e tempest-VolumesMetadataTest-975791418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-225bba16-4c88-4a44-8e8e-274f7ae2b06e tempest-VolumesMetadataTest-975791418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-225bba16-4c88-4a44-8e8e-274f7ae2b06e tempest-VolumesMetadataTest-975791418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-225bba16-4c88-4a44-8e8e-274f7ae2b06e tempest-VolumesMetadataTest-975791418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:37 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:16:37 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:37 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe" returned: 0 in 0.478s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:37 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe Jul 22 12:16:37 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:37 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_15xhay44" returned: 1 in 0.396s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_15xhay44' failed. Not Retrying. {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[72993578-bd60-41e9-8533-55e2502c26db]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_v6tw695ldevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:37 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-225bba16-4c88-4a44-8e8e-274f7ae2b06e tempest-VolumesMetadataTest-975791418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.315s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-225bba16-4c88-4a44-8e8e-274f7ae2b06e tempest-VolumesMetadataTest-975791418 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:16:37 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-225bba16-4c88-4a44-8e8e-274f7ae2b06e tempest-VolumesMetadataTest-975791418 None] Deleted volume successfully. Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-225bba16-4c88-4a44-8e8e-274f7ae2b06e tempest-VolumesMetadataTest-975791418 None] Lock "cinder-5a74a959-c3b1-43e9-970b-2360c464bbb9-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:37 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_v6tw695ldevstack@QuobyteHD Jul 22 12:16:37 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:37 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484.505bd9f2-9a73-491d-95fa-2ba612b64fbe" returned: 0 in 0.354s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-quobyte-505bd9f2-9a73-491d-95fa-2ba612b64fbe" released by "_delete_snapshot" :: held 1.978s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-quobyte-35240488-db02-4505-803b-e77156506484" released by "delete_snapshot" :: held 2.003s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Created reservations ['558b3e8f-1336-45da-b0f8-22c3908ad75d', '4b7c8413-7c28-4886-aaee-1ba281e63abb', 'c5b7a22c-1489-446b-a6a1-4599c03996c5', '51006d2f-cdd0-408d-985b-0cf96bc597c0'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:16:37 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_v6tw695ldevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] 97d73ec3-9d73-4df3-baa6-cc90fa33d35e was qcow2, converting to qcow2 {{(pid=87568) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 12:16:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_v6tw695ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:37 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_v6tw695ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b Jul 22 12:16:37 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:38 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Delete snapshot completed successfully. Jul 22 12:16:38 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-505bd9f2-9a73-491d-95fa-2ba612b64fbe-delete_snapshot" released by "delete_snapshot" :: held 2.197s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Snapshots deleted, issuing volume delete {{(pid=87568) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 22 12:16:38 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "cinder-quobyte-35240488-db02-4505-803b-e77156506484" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:38 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-quobyte-35240488-db02-4505-803b-e77156506484" acquired by "delete_volume" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:38 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[225a973c-6a0f-4d72-b3b4-4a5ae430bbc4]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:38 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484 Jul 22 12:16:38 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:38 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484" returned: 0 in 0.390s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:38 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484 Jul 22 12:16:38 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:38 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35240488-db02-4505-803b-e77156506484" returned: 0 in 0.344s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:38 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-quobyte-35240488-db02-4505-803b-e77156506484" released by "delete_volume" :: held 0.813s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:38 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Created reservations ['9da547e3-224a-4a73-8087-c73cccbb92ee', 'eb656c5b-1c6d-488f-9c3f-ae36176bd7e3', 'c4b2ddaf-822a-4862-b8fb-89ea14b908d1', 'a31bcb98-ca16-46e7-9b0a-9b2abbca09c2'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:16:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:39 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:16:39 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:39 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.361s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:39 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:16:39 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Deleted volume successfully. Jul 22 12:16:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1c73947b-f52a-464d-b24d-1744c7e35221 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-35240488-db02-4505-803b-e77156506484-delete_volume" released by "delete_volume" :: held 6.102s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:40 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_v6tw695ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b" returned: 0 in 2.352s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_v6tw695ldevstack@QuobyteHD, size 112.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:16:40 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Converted 112.00 MB image at 47.60 MB/s Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:40 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b 1G Jul 22 12:16:40 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:40 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b 1G" returned: 0 in 0.413s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Downloaded image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e ((None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}])) to volume fc415ec6-b994-460c-ab3c-c486c1e2795b successfully. {{(pid=87568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Temporary image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e for user 800e0dab3c2c4553ad7bc1862d60d500 is deleted. {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Marking volume fc415ec6-b994-460c-ab3c-c486c1e2795b as bootable. {{(pid=87568) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Copying metadata from image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e to fc415ec6-b994-460c-ab3c-c486c1e2795b. {{(pid=87568) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Creating volume glance metadata for volume fc415ec6-b994-460c-ab3c-c486c1e2795b backed by image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87568) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Flow 'volume_create_manager' (81ba232f-acb7-4af6-b901-9864a3baa25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7c10b7-051f-495c-b57c-7638ebee1a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7c10b7-051f-495c-b57c-7638ebee1a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1046623495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864feade-3e82-478e-ad15-3524f38b2c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03527ce37d045cfb4aab87ab7dc66e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:41Z,use_quota=True,user_id='11791b64dca44069b22ec83015edf720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd700fe-a53e-4a9b-ab7d-b8021a92f094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd700fe-a53e-4a9b-ab7d-b8021a92f094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b9bd51-198c-4128-9345-107eb1b13975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b9bd51-198c-4128-9345-107eb1b13975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '864feade-3e82-478e-ad15-3524f38b2c06', 'volume_name': 'volume-864feade-3e82-478e-ad15-3524f38b2c06', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec1dfe93-28e0-4cf2-8447-a04e64211bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec1dfe93-28e0-4cf2-8447-a04e64211bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ae3218-6e4c-4850-81ac-be80fa9e6042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:40 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Volume 864feade-3e82-478e-ad15-3524f38b2c06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-864feade-3e82-478e-ad15-3524f38b2c06', 'volume_size': 1} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1046623495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864feade-3e82-478e-ad15-3524f38b2c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03527ce37d045cfb4aab87ab7dc66e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:41Z,use_quota=True,user_id='11791b64dca44069b22ec83015edf720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Creating volume 864feade-3e82-478e-ad15-3524f38b2c06 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:16:40 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:16:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:40 devstack sudo[96742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06 1073741824 Jul 22 12:16:40 devstack sudo[96742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ca9bce-5dbc-4267-842b-0d60ac2222f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc415ec6-b994-460c-ab3c-c486c1e2795b', 'volume_size': 1, 'image_id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fe02ba8749e04b7eaeb23823f684fdc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'created_at': datetime.datetime(2026, 7, 22, 10, 2, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 2, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47f270c-93c1-42ea-99f0-9023339aa98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:41 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Volume volume-fc415ec6-b994-460c-ab3c-c486c1e2795b (fc415ec6-b994-460c-ab3c-c486c1e2795b): created successfully Jul 22 12:16:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47f270c-93c1-42ea-99f0-9023339aa98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Flow 'volume_create_manager' (b4480e5b-9a65-4f1e-8f79-5ead7e624b5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:41 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-0ff8d892-ac2e-4fa9-b6f3-166b3d82652b tempest-VolumesExtendTest-747104871 None] Created volume successfully. Jul 22 12:16:41 devstack sudo[96742]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06 1073741824" returned: 0 in 0.568s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:41 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06 Jul 22 12:16:41 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:41 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06" returned: 0 in 0.278s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:16:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ae3218-6e4c-4850-81ac-be80fa9e6042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-864feade-3e82-478e-ad15-3524f38b2c06', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbfbae8-749e-4664-891a-da4232dcbef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:41 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Volume volume-864feade-3e82-478e-ad15-3524f38b2c06 (864feade-3e82-478e-ad15-3524f38b2c06): created successfully Jul 22 12:16:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbfbae8-749e-4664-891a-da4232dcbef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Flow 'volume_create_manager' (81ba232f-acb7-4af6-b901-9864a3baa25d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:41 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-43736408-f72c-444f-949d-a1527d845e19 tempest-VolumesDeleteCascade-63650561 None] Created volume successfully. Jul 22 12:16:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4d07964d-563a-4fb3-b4ea-b9500e33633c tempest-VolumesExtendTest-747104871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4d07964d-563a-4fb3-b4ea-b9500e33633c tempest-VolumesExtendTest-747104871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:42 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7c8e78-caad-4d57-a605-3c52dc668819]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4d07964d-563a-4fb3-b4ea-b9500e33633c tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:42 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b Jul 22 12:16:42 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:42 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4d07964d-563a-4fb3-b4ea-b9500e33633c tempest-VolumesExtendTest-747104871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b" returned: 0 in 0.499s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4d07964d-563a-4fb3-b4ea-b9500e33633c tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b 2G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4d07964d-563a-4fb3-b4ea-b9500e33633c tempest-VolumesExtendTest-747104871 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b 2G" returned: 0 in 0.185s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4d07964d-563a-4fb3-b4ea-b9500e33633c tempest-VolumesExtendTest-747104871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.713s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aeb2328d-f2fa-493f-a6fc-8ef1158fea5f tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aeb2328d-f2fa-493f-a6fc-8ef1158fea5f tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:43 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-aeb2328d-f2fa-493f-a6fc-8ef1158fea5f tempest-VolumesDeleteCascade-63650561 None] Creating offline snapshot 27d3cf05-a0db-4505-a518-5bdac6f8a981 of volume 864feade-3e82-478e-ad15-3524f38b2c06 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:16:43 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60998dd-34a2-43e3-a46f-afd8976fb572]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aeb2328d-f2fa-493f-a6fc-8ef1158fea5f tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:43 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-4d07964d-563a-4fb3-b4ea-b9500e33633c tempest-VolumesExtendTest-747104871 None] Extend volume completed successfully. Jul 22 12:16:43 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06 Jul 22 12:16:43 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:43 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aeb2328d-f2fa-493f-a6fc-8ef1158fea5f tempest-VolumesDeleteCascade-63650561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06" returned: 0 in 0.488s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aeb2328d-f2fa-493f-a6fc-8ef1158fea5f tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:43 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981 1G Jul 22 12:16:43 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:43 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-da5b3b4a-cd14-4c84-91cf-533a6431b618 tempest-VolumesExtendTest-747104871 None] Acquiring lock "cinder-fc415ec6-b994-460c-ab3c-c486c1e2795b-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:43 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-da5b3b4a-cd14-4c84-91cf-533a6431b618 tempest-VolumesExtendTest-747104871 None] Lock "cinder-fc415ec6-b994-460c-ab3c-c486c1e2795b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:43 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-da5b3b4a-cd14-4c84-91cf-533a6431b618 tempest-VolumesExtendTest-747104871 None] Acquiring lock "cinder-quobyte-fc415ec6-b994-460c-ab3c-c486c1e2795b" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:43 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-da5b3b4a-cd14-4c84-91cf-533a6431b618 tempest-VolumesExtendTest-747104871 None] Lock "cinder-quobyte-fc415ec6-b994-460c-ab3c-c486c1e2795b" acquired by "delete_volume" :: waited 0.014s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:43 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a39866-534d-4f37-863b-e49a52a8212e]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-da5b3b4a-cd14-4c84-91cf-533a6431b618 tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:44 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b Jul 22 12:16:44 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:44 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aeb2328d-f2fa-493f-a6fc-8ef1158fea5f tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981 1G" returned: 0 in 0.558s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aeb2328d-f2fa-493f-a6fc-8ef1158fea5f tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-864feade-3e82-478e-ad15-3524f38b2c06 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:44 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-864feade-3e82-478e-ad15-3524f38b2c06 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981 Jul 22 12:16:44 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:44 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-da5b3b4a-cd14-4c84-91cf-533a6431b618 tempest-VolumesExtendTest-747104871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b" returned: 0 in 0.451s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-da5b3b4a-cd14-4c84-91cf-533a6431b618 tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:44 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b Jul 22 12:16:44 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:44 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aeb2328d-f2fa-493f-a6fc-8ef1158fea5f tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-864feade-3e82-478e-ad15-3524f38b2c06 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981" returned: 0 in 0.382s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:44 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-aeb2328d-f2fa-493f-a6fc-8ef1158fea5f tempest-VolumesDeleteCascade-63650561 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981 is being set with open permissions: ugo+rw Jul 22 12:16:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aeb2328d-f2fa-493f-a6fc-8ef1158fea5f tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:44 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981 Jul 22 12:16:44 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:44 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-da5b3b4a-cd14-4c84-91cf-533a6431b618 tempest-VolumesExtendTest-747104871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fc415ec6-b994-460c-ab3c-c486c1e2795b" returned: 0 in 0.299s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:44 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-da5b3b4a-cd14-4c84-91cf-533a6431b618 tempest-VolumesExtendTest-747104871 None] Lock "cinder-quobyte-fc415ec6-b994-460c-ab3c-c486c1e2795b" released by "delete_volume" :: held 0.826s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:44 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-da5b3b4a-cd14-4c84-91cf-533a6431b618 tempest-VolumesExtendTest-747104871 None] Created reservations ['deccbcea-5bac-4af0-a109-1ed7c4117152', 'e9034f3d-14d2-4f6b-9c5d-1305d2f56f23', '253bdb4d-6188-44c9-90bc-ec866f21d5e6', 'f4368f02-1586-4a5d-b673-75074b259268'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:16:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-da5b3b4a-cd14-4c84-91cf-533a6431b618 tempest-VolumesExtendTest-747104871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-da5b3b4a-cd14-4c84-91cf-533a6431b618 tempest-VolumesExtendTest-747104871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:44 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-da5b3b4a-cd14-4c84-91cf-533a6431b618 tempest-VolumesExtendTest-747104871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:44 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-da5b3b4a-cd14-4c84-91cf-533a6431b618 tempest-VolumesExtendTest-747104871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-da5b3b4a-cd14-4c84-91cf-533a6431b618 tempest-VolumesExtendTest-747104871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-da5b3b4a-cd14-4c84-91cf-533a6431b618 tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:44 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aeb2328d-f2fa-493f-a6fc-8ef1158fea5f tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981" returned: 0 in 0.349s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:44 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:16:44 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aeb2328d-f2fa-493f-a6fc-8ef1158fea5f tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:45 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.info Jul 22 12:16:45 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:45 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-da5b3b4a-cd14-4c84-91cf-533a6431b618 tempest-VolumesExtendTest-747104871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.387s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-da5b3b4a-cd14-4c84-91cf-533a6431b618 tempest-VolumesExtendTest-747104871 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:16:45 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-da5b3b4a-cd14-4c84-91cf-533a6431b618 tempest-VolumesExtendTest-747104871 None] Deleted volume successfully. Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-da5b3b4a-cd14-4c84-91cf-533a6431b618 tempest-VolumesExtendTest-747104871 None] Lock "cinder-fc415ec6-b994-460c-ab3c-c486c1e2795b-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:45 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aeb2328d-f2fa-493f-a6fc-8ef1158fea5f tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.info" returned: 0 in 0.409s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:45 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-aeb2328d-f2fa-493f-a6fc-8ef1158fea5f tempest-VolumesDeleteCascade-63650561 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.info is being set with open permissions: ugo+rw Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aeb2328d-f2fa-493f-a6fc-8ef1158fea5f tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:45 devstack sudo[96793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.info Jul 22 12:16:45 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:45 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aeb2328d-f2fa-493f-a6fc-8ef1158fea5f tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.info" returned: 0 in 0.378s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aeb2328d-f2fa-493f-a6fc-8ef1158fea5f tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.699s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Flow 'volume_create_manager' (8b98167f-2e07-4e38-a721-98340545de3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f938b0b-d09b-4dd3-89ca-87a2a21608e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f938b0b-d09b-4dd3-89ca-87a2a21608e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1806968896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26b62a6-a442-4883-b8a6-14fd1347bfde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5e352de52742e7b8dd4ed44b45ed83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:46Z,use_quota=True,user_id='800e0dab3c2c4553ad7bc1862d60d500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ad8fde-5efa-45a0-b671-28d5bbaec7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ad8fde-5efa-45a0-b671-28d5bbaec7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b884c7-dbad-4475-902e-ff19cb19bbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b884c7-dbad-4475-902e-ff19cb19bbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a26b62a6-a442-4883-b8a6-14fd1347bfde', 'volume_name': 'volume-a26b62a6-a442-4883-b8a6-14fd1347bfde', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60537d4-10f0-432c-8c12-146073af129c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60537d4-10f0-432c-8c12-146073af129c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08fd2278-a1d4-4863-af0a-ec1c959123a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:45 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Volume a26b62a6-a442-4883-b8a6-14fd1347bfde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a26b62a6-a442-4883-b8a6-14fd1347bfde', 'volume_size': 1} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1806968896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26b62a6-a442-4883-b8a6-14fd1347bfde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5e352de52742e7b8dd4ed44b45ed83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:46Z,use_quota=True,user_id='800e0dab3c2c4553ad7bc1862d60d500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Creating volume a26b62a6-a442-4883-b8a6-14fd1347bfde {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:16:45 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:16:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:45 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-aeb2328d-f2fa-493f-a6fc-8ef1158fea5f tempest-VolumesDeleteCascade-63650561 None] Create snapshot completed successfully Jul 22 12:16:45 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde 1073741824 Jul 22 12:16:45 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:46 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde 1073741824" returned: 0 in 0.544s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:46 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde Jul 22 12:16:46 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:46 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde" returned: 0 in 0.363s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:46 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:16:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:46 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08fd2278-a1d4-4863-af0a-ec1c959123a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a26b62a6-a442-4883-b8a6-14fd1347bfde', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:46 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9cb6fc8-0f2f-4db8-b43f-f711132d6b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:46 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Volume volume-a26b62a6-a442-4883-b8a6-14fd1347bfde (a26b62a6-a442-4883-b8a6-14fd1347bfde): created successfully Jul 22 12:16:46 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9cb6fc8-0f2f-4db8-b43f-f711132d6b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:46 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Flow 'volume_create_manager' (8b98167f-2e07-4e38-a721-98340545de3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:46 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-60fad964-1850-4fc6-a282-5eb2f1a7ccfb tempest-VolumesExtendTest-747104871 None] Created volume successfully. Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Flow 'volume_create_manager' (57f4ef87-b686-45e7-af81-e2df0cb7a4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095676df-ab3a-45dd-a940-60642a5bd244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095676df-ab3a-45dd-a940-60642a5bd244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1145087696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984dcd02-4b4d-4746-9fc4-74c419797311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03527ce37d045cfb4aab87ab7dc66e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=27d3cf05-a0db-4505-a518-5bdac6f8a981,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:47Z,use_quota=True,user_id='11791b64dca44069b22ec83015edf720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a71480-5f8b-46cf-b26f-b551b1781d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a71480-5f8b-46cf-b26f-b551b1781d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab4c473-e9cb-4705-8c6a-f2e6831722d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab4c473-e9cb-4705-8c6a-f2e6831722d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '984dcd02-4b4d-4746-9fc4-74c419797311', 'volume_name': 'volume-984dcd02-4b4d-4746-9fc4-74c419797311', 'volume_size': 1, 'snapshot_id': '27d3cf05-a0db-4505-a518-5bdac6f8a981'}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91f3500-bc79-43b3-acfa-e5ca54c06126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91f3500-bc79-43b3-acfa-e5ca54c06126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b9203c-dac5-4f7d-9259-3ea7f82412fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:47 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Volume 984dcd02-4b4d-4746-9fc4-74c419797311: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-984dcd02-4b4d-4746-9fc4-74c419797311', 'volume_size': 1, 'snapshot_id': '27d3cf05-a0db-4505-a518-5bdac6f8a981'} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "cinder-quobyte-27d3cf05-a0db-4505-a518-5bdac6f8a981-984dcd02-4b4d-4746-9fc4-74c419797311" by "_create_volume_from_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-quobyte-27d3cf05-a0db-4505-a518-5bdac6f8a981-984dcd02-4b4d-4746-9fc4-74c419797311" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Creating volume 984dcd02-4b4d-4746-9fc4-74c419797311 from snapshot 27d3cf05-a0db-4505-a518-5bdac6f8a981 {{(pid=87568) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "cinder-quobyte-984dcd02-4b4d-4746-9fc4-74c419797311" by "_copy_volume_from_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-quobyte-984dcd02-4b4d-4746-9fc4-74c419797311" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] snapshot: 27d3cf05-a0db-4505-a518-5bdac6f8a981, volume: 984dcd02-4b4d-4746-9fc4-74c419797311, {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40d93c6-e746-4e67-b4b9-1a8edff1edcf]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:47 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981 Jul 22 12:16:47 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:47 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981" returned: 0 in 0.386s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-864feade-3e82-478e-ad15-3524f38b2c06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] will copy from snapshot at /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06 {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Creating direct copy from snapshot {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a6ebd3-5902-4923-91fe-40b9c59c8a15]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:47 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06 Jul 22 12:16:47 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7e2963ee-eb9a-4e30-bb81-176af869af11 tempest-VolumesExtendTest-747104871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:48 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06" returned: 0 in 0.541s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:48 devstack cinder-volume[87568]: DEBUG cinder.utils [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Path /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-984dcd02-4b4d-4746-9fc4-74c419797311 not found in is_blk_device check {{(pid=87568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 12:16:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-984dcd02-4b4d-4746-9fc4-74c419797311 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:48 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-984dcd02-4b4d-4746-9fc4-74c419797311 Jul 22 12:16:48 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:54 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-984dcd02-4b4d-4746-9fc4-74c419797311" returned: 0 in 5.878s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:54 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40eec68-31c5-4b3a-bc18-d5568054b66f]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:54 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06 Jul 22 12:16:54 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:54 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06" returned: 0 in 0.639s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:54 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Image conversion details: src /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-984dcd02-4b4d-4746-9fc4-74c419797311 {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:16:54 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Converted 1024.00 MB image at 174.17 MB/s Jul 22 12:16:54 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-984dcd02-4b4d-4746-9fc4-74c419797311 is being set with open permissions: ugo+rw Jul 22 12:16:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-984dcd02-4b4d-4746-9fc4-74c419797311 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:54 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-984dcd02-4b4d-4746-9fc4-74c419797311 Jul 22 12:16:54 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:55 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-984dcd02-4b4d-4746-9fc4-74c419797311" returned: 0 in 0.329s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-quobyte-984dcd02-4b4d-4746-9fc4-74c419797311" released by "_copy_volume_from_snapshot" :: held 7.896s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-quobyte-27d3cf05-a0db-4505-a518-5bdac6f8a981-984dcd02-4b4d-4746-9fc4-74c419797311" released by "_create_volume_from_snapshot" :: held 7.934s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.958s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7e2963ee-eb9a-4e30-bb81-176af869af11 tempest-VolumesExtendTest-747104871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.953s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:55 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-7e2963ee-eb9a-4e30-bb81-176af869af11 tempest-VolumesExtendTest-747104871 None] Creating offline snapshot 97fe90d7-0416-4513-9b0b-08935e62683e of volume a26b62a6-a442-4883-b8a6-14fd1347bfde {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:16:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b9203c-dac5-4f7d-9259-3ea7f82412fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-984dcd02-4b4d-4746-9fc4-74c419797311', 'volume_size': 1, 'snapshot_id': '27d3cf05-a0db-4505-a518-5bdac6f8a981'}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11e8c6c-926e-4646-ac69-acc2b59fd0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:55 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[32691054-87dd-40b8-98c1-cf3eb7f0b40b]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7e2963ee-eb9a-4e30-bb81-176af869af11 tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:55 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Volume volume-984dcd02-4b4d-4746-9fc4-74c419797311 (984dcd02-4b4d-4746-9fc4-74c419797311): created successfully Jul 22 12:16:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11e8c6c-926e-4646-ac69-acc2b59fd0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Flow 'volume_create_manager' (57f4ef87-b686-45e7-af81-e2df0cb7a4e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:55 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-13ec106c-7bc7-4a86-b1e6-f240f8ab36b6 tempest-VolumesDeleteCascade-63650561 None] Created volume successfully. Jul 22 12:16:55 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde Jul 22 12:16:55 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:55 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7e2963ee-eb9a-4e30-bb81-176af869af11 tempest-VolumesExtendTest-747104871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde" returned: 0 in 0.478s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7e2963ee-eb9a-4e30-bb81-176af869af11 tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.97fe90d7-0416-4513-9b0b-08935e62683e 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:55 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.97fe90d7-0416-4513-9b0b-08935e62683e 1G Jul 22 12:16:55 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "cinder-864feade-3e82-478e-ad15-3524f38b2c06-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-864feade-3e82-478e-ad15-3524f38b2c06-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:56 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7e2963ee-eb9a-4e30-bb81-176af869af11 tempest-VolumesExtendTest-747104871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.97fe90d7-0416-4513-9b0b-08935e62683e 1G" returned: 0 in 0.649s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7e2963ee-eb9a-4e30-bb81-176af869af11 tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a26b62a6-a442-4883-b8a6-14fd1347bfde -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.97fe90d7-0416-4513-9b0b-08935e62683e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:56 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Performing cascade delete. {{(pid=87568) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 22 12:16:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "cinder-27d3cf05-a0db-4505-a518-5bdac6f8a981-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:56 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a26b62a6-a442-4883-b8a6-14fd1347bfde -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.97fe90d7-0416-4513-9b0b-08935e62683e Jul 22 12:16:56 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-27d3cf05-a0db-4505-a518-5bdac6f8a981-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "cinder-quobyte-864feade-3e82-478e-ad15-3524f38b2c06" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-quobyte-864feade-3e82-478e-ad15-3524f38b2c06" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "cinder-quobyte-27d3cf05-a0db-4505-a518-5bdac6f8a981" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-quobyte-27d3cf05-a0db-4505-a518-5bdac6f8a981" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:56 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Deleting offline snapshot 27d3cf05-a0db-4505-a518-5bdac6f8a981 of volume 864feade-3e82-478e-ad15-3524f38b2c06 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:16:56 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] snapshot_file for this snap is: volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:16:56 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae8eca6-bf1a-455e-ba28-6b04471f3118]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:56 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981 Jul 22 12:16:56 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:56 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7e2963ee-eb9a-4e30-bb81-176af869af11 tempest-VolumesExtendTest-747104871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a26b62a6-a442-4883-b8a6-14fd1347bfde -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.97fe90d7-0416-4513-9b0b-08935e62683e" returned: 0 in 0.420s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:56 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-7e2963ee-eb9a-4e30-bb81-176af869af11 tempest-VolumesExtendTest-747104871 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.97fe90d7-0416-4513-9b0b-08935e62683e is being set with open permissions: ugo+rw Jul 22 12:16:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7e2963ee-eb9a-4e30-bb81-176af869af11 tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.97fe90d7-0416-4513-9b0b-08935e62683e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:56 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.97fe90d7-0416-4513-9b0b-08935e62683e Jul 22 12:16:56 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:57 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981" returned: 0 in 0.561s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-864feade-3e82-478e-ad15-3524f38b2c06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:16:57 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7e2963ee-eb9a-4e30-bb81-176af869af11 tempest-VolumesExtendTest-747104871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.97fe90d7-0416-4513-9b0b-08935e62683e" returned: 0 in 0.353s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:57 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[3125f409-d31e-4b56-97e7-7667654249cf]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7e2963ee-eb9a-4e30-bb81-176af869af11 tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:57 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.info Jul 22 12:16:57 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:57 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06 Jul 22 12:16:57 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:57 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7e2963ee-eb9a-4e30-bb81-176af869af11 tempest-VolumesExtendTest-747104871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.info" returned: 0 in 0.422s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:57 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-7e2963ee-eb9a-4e30-bb81-176af869af11 tempest-VolumesExtendTest-747104871 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.info is being set with open permissions: ugo+rw Jul 22 12:16:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7e2963ee-eb9a-4e30-bb81-176af869af11 tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:57 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.info Jul 22 12:16:57 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:57 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06" returned: 0 in 0.566s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:57 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981 Jul 22 12:16:57 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:57 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7e2963ee-eb9a-4e30-bb81-176af869af11 tempest-VolumesExtendTest-747104871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.info" returned: 0 in 0.286s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7e2963ee-eb9a-4e30-bb81-176af869af11 tempest-VolumesExtendTest-747104871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.779s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:57 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-7e2963ee-eb9a-4e30-bb81-176af869af11 tempest-VolumesExtendTest-747104871 None] Create snapshot completed successfully Jul 22 12:16:58 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981" returned: 0 in 0.471s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:58 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981 Jul 22 12:16:58 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:58 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06.27d3cf05-a0db-4505-a518-5bdac6f8a981" returned: 0 in 0.392s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-quobyte-27d3cf05-a0db-4505-a518-5bdac6f8a981" released by "_delete_snapshot" :: held 2.145s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-quobyte-864feade-3e82-478e-ad15-3524f38b2c06" released by "delete_snapshot" :: held 2.186s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Flow 'volume_create_manager' (2e66d1f3-d3f2-4f20-bf31-af944e0c6e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea4d141c-1162-46fe-8df9-dcbfd0ddcf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea4d141c-1162-46fe-8df9-dcbfd0ddcf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-562646457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd6cff4-d838-42b9-8dbf-7b765d87a391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aead7412c40451aab21f6c8d06f18ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:59Z,use_quota=True,user_id='7543b47689054944b3c86c7799887de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1dadb3-c63c-48c5-9ba2-6b97cdc8fd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1dadb3-c63c-48c5-9ba2-6b97cdc8fd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78808db-da9b-4585-846a-6a8403301020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78808db-da9b-4585-846a-6a8403301020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cd6cff4-d838-42b9-8dbf-7b765d87a391', 'volume_name': 'volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df95b44a-4c98-46c8-8fbf-c6862f095c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df95b44a-4c98-46c8-8fbf-c6862f095c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b1ce30a-e743-4fa8-b7d7-73b870594279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:58 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Volume 9cd6cff4-d838-42b9-8dbf-7b765d87a391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391', 'volume_size': 1} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-562646457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd6cff4-d838-42b9-8dbf-7b765d87a391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aead7412c40451aab21f6c8d06f18ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:16:59Z,use_quota=True,user_id='7543b47689054944b3c86c7799887de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Creating volume 9cd6cff4-d838-42b9-8dbf-7b765d87a391 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:16:58 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:58 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 1073741824 Jul 22 12:16:58 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Created reservations ['f7a1244c-7f6e-45a7-9793-75d9902e3fd7', 'ed846d1f-8554-473a-9973-dc8675d33aef', '1cf180ea-daf2-4a4c-9cd7-b23bb9b082c8', '113987eb-630c-4da7-834e-dc52de52626b'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:16:58 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Delete snapshot completed successfully. Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-27d3cf05-a0db-4505-a518-5bdac6f8a981-delete_snapshot" released by "delete_snapshot" :: held 2.563s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Snapshots deleted, issuing volume delete {{(pid=87568) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "cinder-quobyte-864feade-3e82-478e-ad15-3524f38b2c06" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:16:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-quobyte-864feade-3e82-478e-ad15-3524f38b2c06" acquired by "delete_volume" :: waited 0.029s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:16:59 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2ac7c2-e232-4502-8765-78ac273bd50e]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-21096995-5904-402b-87fe-3d1e63d3c36e tempest-VolumesExtendTest-747104871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:16:59 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06 Jul 22 12:16:59 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:59 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 1073741824" returned: 0 in 0.608s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:59 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 Jul 22 12:16:59 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:59 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06" returned: 0 in 0.535s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:59 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06 Jul 22 12:16:59 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:59 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391" returned: 0 in 0.322s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:16:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:16:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-21096995-5904-402b-87fe-3d1e63d3c36e tempest-VolumesExtendTest-747104871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.542s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:16:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b1ce30a-e743-4fa8-b7d7-73b870594279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0948339-11b5-4b12-a182-f0338eb2b929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:16:59 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5e6116-281f-4d43-8f18-7d9463fc3a50]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:16:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-21096995-5904-402b-87fe-3d1e63d3c36e tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:16:59 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Volume volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 (9cd6cff4-d838-42b9-8dbf-7b765d87a391): created successfully Jul 22 12:16:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0948339-11b5-4b12-a182-f0338eb2b929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:16:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Flow 'volume_create_manager' (2e66d1f3-d3f2-4f20-bf31-af944e0c6e88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:16:59 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-9bcfcc56-7715-428f-be03-b6ce0dc401c6 tempest-VolumesActionsTest-1474808239 None] Created volume successfully. Jul 22 12:16:59 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Jul 22 12:16:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-864feade-3e82-478e-ad15-3524f38b2c06" returned: 0 in 0.275s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:16:59 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-quobyte-864feade-3e82-478e-ad15-3524f38b2c06" released by "delete_volume" :: held 0.921s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:16:59 devstack sudo[96898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde Jul 22 12:16:59 devstack sudo[96898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:16:59 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Created reservations ['58467f98-1a5e-4499-9c46-aed2c7fc4b65', '48157fa8-d3ad-449d-9080-59d897853584', '02b7e2c9-6943-41fc-8609-da6520205871', '6f0a5408-0162-45f5-a25d-3c73df59e4bd'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:17:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:17:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:17:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:17:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:17:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:17:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:00 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:17:00 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:00 devstack sudo[96898]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-21096995-5904-402b-87fe-3d1e63d3c36e tempest-VolumesExtendTest-747104871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde" returned: 0 in 0.539s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-21096995-5904-402b-87fe-3d1e63d3c36e tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.97fe90d7-0416-4513-9b0b-08935e62683e 2G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:00 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.344s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:00 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:17:00 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Deleted volume successfully. Jul 22 12:17:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-519cb6db-05e9-4299-ab8b-e37f83eeb2c6 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-864feade-3e82-478e-ad15-3524f38b2c06-delete_volume" released by "delete_volume" :: held 4.208s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-21096995-5904-402b-87fe-3d1e63d3c36e tempest-VolumesExtendTest-747104871 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.97fe90d7-0416-4513-9b0b-08935e62683e 2G" returned: 0 in 0.152s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-21096995-5904-402b-87fe-3d1e63d3c36e tempest-VolumesExtendTest-747104871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.749s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:17:00 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-21096995-5904-402b-87fe-3d1e63d3c36e tempest-VolumesExtendTest-747104871 None] Extend volume completed successfully. Jul 22 12:17:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6a1b49d1-b016-48ae-b697-74078d908b03 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "cinder-984dcd02-4b4d-4746-9fc4-74c419797311-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6a1b49d1-b016-48ae-b697-74078d908b03 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-984dcd02-4b4d-4746-9fc4-74c419797311-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6a1b49d1-b016-48ae-b697-74078d908b03 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "cinder-quobyte-984dcd02-4b4d-4746-9fc4-74c419797311" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6a1b49d1-b016-48ae-b697-74078d908b03 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-quobyte-984dcd02-4b4d-4746-9fc4-74c419797311" acquired by "delete_volume" :: waited 0.021s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:00 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1439a17-95ba-45b9-ae28-1b4409ed0e06]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:17:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6a1b49d1-b016-48ae-b697-74078d908b03 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-984dcd02-4b4d-4746-9fc4-74c419797311 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:01 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-984dcd02-4b4d-4746-9fc4-74c419797311 Jul 22 12:17:01 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:01 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6a1b49d1-b016-48ae-b697-74078d908b03 tempest-VolumesDeleteCascade-63650561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-984dcd02-4b4d-4746-9fc4-74c419797311" returned: 0 in 0.445s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6a1b49d1-b016-48ae-b697-74078d908b03 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-984dcd02-4b4d-4746-9fc4-74c419797311 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:01 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-984dcd02-4b4d-4746-9fc4-74c419797311 Jul 22 12:17:01 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-957ead68-4268-41f2-907b-832c465dcf2f tempest-VolumesExtendTest-747104871 None] Acquiring lock "cinder-97fe90d7-0416-4513-9b0b-08935e62683e-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-957ead68-4268-41f2-907b-832c465dcf2f tempest-VolumesExtendTest-747104871 None] Lock "cinder-97fe90d7-0416-4513-9b0b-08935e62683e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-957ead68-4268-41f2-907b-832c465dcf2f tempest-VolumesExtendTest-747104871 None] Acquiring lock "cinder-quobyte-a26b62a6-a442-4883-b8a6-14fd1347bfde" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-957ead68-4268-41f2-907b-832c465dcf2f tempest-VolumesExtendTest-747104871 None] Lock "cinder-quobyte-a26b62a6-a442-4883-b8a6-14fd1347bfde" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-957ead68-4268-41f2-907b-832c465dcf2f tempest-VolumesExtendTest-747104871 None] Acquiring lock "cinder-quobyte-97fe90d7-0416-4513-9b0b-08935e62683e" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-957ead68-4268-41f2-907b-832c465dcf2f tempest-VolumesExtendTest-747104871 None] Lock "cinder-quobyte-97fe90d7-0416-4513-9b0b-08935e62683e" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-957ead68-4268-41f2-907b-832c465dcf2f tempest-VolumesExtendTest-747104871 None] Deleting offline snapshot 97fe90d7-0416-4513-9b0b-08935e62683e of volume a26b62a6-a442-4883-b8a6-14fd1347bfde {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:17:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-957ead68-4268-41f2-907b-832c465dcf2f tempest-VolumesExtendTest-747104871 None] snapshot_file for this snap is: volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.97fe90d7-0416-4513-9b0b-08935e62683e {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:17:01 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6a1b49d1-b016-48ae-b697-74078d908b03 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-984dcd02-4b4d-4746-9fc4-74c419797311" returned: 0 in 0.376s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:01 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[410ec510-0876-4be2-adad-0c5ddb339dc8]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:17:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-957ead68-4268-41f2-907b-832c465dcf2f tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.97fe90d7-0416-4513-9b0b-08935e62683e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6a1b49d1-b016-48ae-b697-74078d908b03 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-quobyte-984dcd02-4b4d-4746-9fc4-74c419797311" released by "delete_volume" :: held 0.895s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:01 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=120,cinder:INSERT=49,cinder:UPDATE=156,cinder:DELETE=17 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:17:01 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-6a1b49d1-b016-48ae-b697-74078d908b03 tempest-VolumesDeleteCascade-63650561 None] Created reservations ['87409a85-4a67-466b-b761-67c11bba43b7', 'ce775623-587c-483b-b889-119e982686e9', '522c0318-c312-4954-9d6a-a6ee2b9e8312', '09a5122b-a631-4f16-aba4-c688b08aa962'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:17:02 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.97fe90d7-0416-4513-9b0b-08935e62683e Jul 22 12:17:02 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6a1b49d1-b016-48ae-b697-74078d908b03 tempest-VolumesDeleteCascade-63650561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:17:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6a1b49d1-b016-48ae-b697-74078d908b03 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:17:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6a1b49d1-b016-48ae-b697-74078d908b03 tempest-VolumesDeleteCascade-63650561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:17:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6a1b49d1-b016-48ae-b697-74078d908b03 tempest-VolumesDeleteCascade-63650561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:17:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6a1b49d1-b016-48ae-b697-74078d908b03 tempest-VolumesDeleteCascade-63650561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:17:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6a1b49d1-b016-48ae-b697-74078d908b03 tempest-VolumesDeleteCascade-63650561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:02 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:17:02 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:02 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-957ead68-4268-41f2-907b-832c465dcf2f tempest-VolumesExtendTest-747104871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.97fe90d7-0416-4513-9b0b-08935e62683e" returned: 0 in 0.538s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-957ead68-4268-41f2-907b-832c465dcf2f tempest-VolumesExtendTest-747104871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a26b62a6-a442-4883-b8a6-14fd1347bfde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:17:02 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6a1b49d1-b016-48ae-b697-74078d908b03 tempest-VolumesDeleteCascade-63650561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.356s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:02 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-6a1b49d1-b016-48ae-b697-74078d908b03 tempest-VolumesDeleteCascade-63650561 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:17:02 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-6a1b49d1-b016-48ae-b697-74078d908b03 tempest-VolumesDeleteCascade-63650561 None] Deleted volume successfully. Jul 22 12:17:02 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadef0c0-2dd5-4cc1-a781-29f87f88513a]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:17:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-957ead68-4268-41f2-907b-832c465dcf2f tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:02 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6a1b49d1-b016-48ae-b697-74078d908b03 tempest-VolumesDeleteCascade-63650561 None] Lock "cinder-984dcd02-4b4d-4746-9fc4-74c419797311-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:02 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde Jul 22 12:17:02 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:02 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-957ead68-4268-41f2-907b-832c465dcf2f tempest-VolumesExtendTest-747104871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde" returned: 0 in 0.417s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-957ead68-4268-41f2-907b-832c465dcf2f tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.97fe90d7-0416-4513-9b0b-08935e62683e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:02 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.97fe90d7-0416-4513-9b0b-08935e62683e Jul 22 12:17:02 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:03 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-957ead68-4268-41f2-907b-832c465dcf2f tempest-VolumesExtendTest-747104871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.97fe90d7-0416-4513-9b0b-08935e62683e" returned: 0 in 0.527s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-957ead68-4268-41f2-907b-832c465dcf2f tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.97fe90d7-0416-4513-9b0b-08935e62683e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:03 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.97fe90d7-0416-4513-9b0b-08935e62683e Jul 22 12:17:03 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:03 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-957ead68-4268-41f2-907b-832c465dcf2f tempest-VolumesExtendTest-747104871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde.97fe90d7-0416-4513-9b0b-08935e62683e" returned: 0 in 0.368s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:03 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:UPDATE=156,cinder:SELECT=144,cinder:INSERT=52,cinder:DELETE=11 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:17:03 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-957ead68-4268-41f2-907b-832c465dcf2f tempest-VolumesExtendTest-747104871 None] Lock "cinder-quobyte-97fe90d7-0416-4513-9b0b-08935e62683e" released by "_delete_snapshot" :: held 2.096s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:03 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-957ead68-4268-41f2-907b-832c465dcf2f tempest-VolumesExtendTest-747104871 None] Lock "cinder-quobyte-a26b62a6-a442-4883-b8a6-14fd1347bfde" released by "delete_snapshot" :: held 2.141s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:03 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-957ead68-4268-41f2-907b-832c465dcf2f tempest-VolumesExtendTest-747104871 None] Created reservations ['348b3768-528d-4fbf-971d-afc1d1fcacab', 'f91ebc6b-9374-45a2-9c3d-3d767189b058', '4ce1a730-a260-4b85-b378-ac4da15c99d4', '7c7ff9b9-ee01-4093-9f7d-5e1bc2666dd7'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:17:04 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-957ead68-4268-41f2-907b-832c465dcf2f tempest-VolumesExtendTest-747104871 None] Delete snapshot completed successfully. Jul 22 12:17:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-957ead68-4268-41f2-907b-832c465dcf2f tempest-VolumesExtendTest-747104871 None] Lock "cinder-97fe90d7-0416-4513-9b0b-08935e62683e-delete_snapshot" released by "delete_snapshot" :: held 2.387s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5866d91-6ce4-46e5-ae88-8c4f040a37b0 tempest-VolumesExtendTest-747104871 None] Acquiring lock "cinder-a26b62a6-a442-4883-b8a6-14fd1347bfde-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5866d91-6ce4-46e5-ae88-8c4f040a37b0 tempest-VolumesExtendTest-747104871 None] Lock "cinder-a26b62a6-a442-4883-b8a6-14fd1347bfde-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5866d91-6ce4-46e5-ae88-8c4f040a37b0 tempest-VolumesExtendTest-747104871 None] Acquiring lock "cinder-quobyte-a26b62a6-a442-4883-b8a6-14fd1347bfde" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5866d91-6ce4-46e5-ae88-8c4f040a37b0 tempest-VolumesExtendTest-747104871 None] Lock "cinder-quobyte-a26b62a6-a442-4883-b8a6-14fd1347bfde" acquired by "delete_volume" :: waited 0.020s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:05 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[8720f6b4-315c-456b-aa47-0f29eb6d63a5]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:17:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5866d91-6ce4-46e5-ae88-8c4f040a37b0 tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:05 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde Jul 22 12:17:05 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:05 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5866d91-6ce4-46e5-ae88-8c4f040a37b0 tempest-VolumesExtendTest-747104871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde" returned: 0 in 0.428s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5866d91-6ce4-46e5-ae88-8c4f040a37b0 tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:05 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde Jul 22 12:17:05 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:05 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5866d91-6ce4-46e5-ae88-8c4f040a37b0 tempest-VolumesExtendTest-747104871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a26b62a6-a442-4883-b8a6-14fd1347bfde" returned: 0 in 0.303s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5866d91-6ce4-46e5-ae88-8c4f040a37b0 tempest-VolumesExtendTest-747104871 None] Lock "cinder-quobyte-a26b62a6-a442-4883-b8a6-14fd1347bfde" released by "delete_volume" :: held 0.808s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:05 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-d5866d91-6ce4-46e5-ae88-8c4f040a37b0 tempest-VolumesExtendTest-747104871 None] Created reservations ['3301768c-cefb-4b18-8997-bfb08ac1b2de', '30522829-b695-4564-83bc-a17551d83e8d', '6d89065b-226a-47dd-917f-15b53dcaa059', 'ec8a63c9-6bcb-4990-aaaa-211414a22a29'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:17:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d5866d91-6ce4-46e5-ae88-8c4f040a37b0 tempest-VolumesExtendTest-747104871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:17:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d5866d91-6ce4-46e5-ae88-8c4f040a37b0 tempest-VolumesExtendTest-747104871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:17:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d5866d91-6ce4-46e5-ae88-8c4f040a37b0 tempest-VolumesExtendTest-747104871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:17:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d5866d91-6ce4-46e5-ae88-8c4f040a37b0 tempest-VolumesExtendTest-747104871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:17:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d5866d91-6ce4-46e5-ae88-8c4f040a37b0 tempest-VolumesExtendTest-747104871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:17:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5866d91-6ce4-46e5-ae88-8c4f040a37b0 tempest-VolumesExtendTest-747104871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:06 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:17:06 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:06 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5866d91-6ce4-46e5-ae88-8c4f040a37b0 tempest-VolumesExtendTest-747104871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.380s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:06 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-d5866d91-6ce4-46e5-ae88-8c4f040a37b0 tempest-VolumesExtendTest-747104871 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:17:06 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d5866d91-6ce4-46e5-ae88-8c4f040a37b0 tempest-VolumesExtendTest-747104871 None] Deleted volume successfully. Jul 22 12:17:06 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5866d91-6ce4-46e5-ae88-8c4f040a37b0 tempest-VolumesExtendTest-747104871 None] Lock "cinder-a26b62a6-a442-4883-b8a6-14fd1347bfde-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:09 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:17:09 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Flow 'volume_create_manager' (9227642e-8a1c-4731-b19b-3ba0a4aae881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:17:09 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b1b6aa1-8d7b-4a65-a89d-ecb72f27963e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:09 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b1b6aa1-8d7b-4a65-a89d-ecb72f27963e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-124346183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca6143d9-c963-47cf-b33d-725554d35368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2655079b00df4192affd1406cc592f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:17:09Z,use_quota=True,user_id='84d5de60ed404226aa57d662398e5910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:09 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84dd093-9f78-4d64-ae83-4df173865d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:09 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84dd093-9f78-4d64-ae83-4df173865d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:09 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73addcc-e3d4-45ea-8029-7451c2f1595c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:09 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73addcc-e3d4-45ea-8029-7451c2f1595c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca6143d9-c963-47cf-b33d-725554d35368', 'volume_name': 'volume-ca6143d9-c963-47cf-b33d-725554d35368', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:09 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2967ba3-0dda-461e-8427-ae2276a918f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:09 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2967ba3-0dda-461e-8427-ae2276a918f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:09 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d727a514-44dc-465d-98e0-00e234f79815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:09 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Volume ca6143d9-c963-47cf-b33d-725554d35368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca6143d9-c963-47cf-b33d-725554d35368', 'volume_size': 1} Jul 22 12:17:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:17:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:17:09 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-124346183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca6143d9-c963-47cf-b33d-725554d35368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2655079b00df4192affd1406cc592f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:17:09Z,use_quota=True,user_id='84d5de60ed404226aa57d662398e5910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:17:09 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Creating volume ca6143d9-c963-47cf-b33d-725554d35368 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:17:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:17:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:17:09 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:17:09 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:17:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:17:09 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:17:09 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:17:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:09 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368 1073741824 Jul 22 12:17:09 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:10 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368 1073741824" returned: 0 in 0.643s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:10 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368 Jul 22 12:17:10 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:10 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368" returned: 0 in 0.504s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:10 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:17:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:17:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d727a514-44dc-465d-98e0-00e234f79815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca6143d9-c963-47cf-b33d-725554d35368', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b0d11d-8a9f-4f4f-8a20-89f1ddf91bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:10 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Volume volume-ca6143d9-c963-47cf-b33d-725554d35368 (ca6143d9-c963-47cf-b33d-725554d35368): created successfully Jul 22 12:17:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b0d11d-8a9f-4f4f-8a20-89f1ddf91bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Flow 'volume_create_manager' (9227642e-8a1c-4731-b19b-3ba0a4aae881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:17:10 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e5ea9c40-ff17-430c-9cb6-1eac11ecef85 tempest-VolumesSnapshotListTestJSON-2014240394 None] Created volume successfully. Jul 22 12:17:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f2b9784f-ff2a-4f2e-9477-10f8b98ab266 tempest-VolumesSnapshotListTestJSON-2014240394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:17:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f2b9784f-ff2a-4f2e-9477-10f8b98ab266 tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:17:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-f2b9784f-ff2a-4f2e-9477-10f8b98ab266 tempest-VolumesSnapshotListTestJSON-2014240394 None] Creating offline snapshot d74ff57c-e503-4ace-9816-17f5ffdf621b of volume ca6143d9-c963-47cf-b33d-725554d35368 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:17:12 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd19fbb8-13aa-48f2-b362-9f7340564ec4]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:17:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f2b9784f-ff2a-4f2e-9477-10f8b98ab266 tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:12 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368 Jul 22 12:17:12 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:12 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f2b9784f-ff2a-4f2e-9477-10f8b98ab266 tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368" returned: 0 in 0.707s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f2b9784f-ff2a-4f2e-9477-10f8b98ab266 tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:12 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b 1G Jul 22 12:17:12 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:13 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:17:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Flow 'volume_create_manager' (af82c51a-e6ab-4fc4-866f-c373cde66f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:17:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d08addef-8fed-46a8-b851-28227ed1e19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d08addef-8fed-46a8-b851-28227ed1e19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2006610729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5cb5abc-7190-4f14-b042-7a92685c1f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd701e1fb0b4fafa99a87acf4e3ea02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:17:13Z,use_quota=True,user_id='2851e8dfaaae419e8cdb90b0578278cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8194cd3-03bb-401c-bd13-7a256749e33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8194cd3-03bb-401c-bd13-7a256749e33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cecb575-9aa1-4d58-802c-759e170f8bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cecb575-9aa1-4d58-802c-759e170f8bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5cb5abc-7190-4f14-b042-7a92685c1f4f', 'volume_name': 'volume-f5cb5abc-7190-4f14-b042-7a92685c1f4f', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068f80be-7336-4968-b0be-c500b0e66675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068f80be-7336-4968-b0be-c500b0e66675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e142e2-06a4-4616-8972-819318752fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:13 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Volume f5cb5abc-7190-4f14-b042-7a92685c1f4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5cb5abc-7190-4f14-b042-7a92685c1f4f', 'volume_size': 1} Jul 22 12:17:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:17:13 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f2b9784f-ff2a-4f2e-9477-10f8b98ab266 tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b 1G" returned: 0 in 0.817s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f2b9784f-ff2a-4f2e-9477-10f8b98ab266 tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca6143d9-c963-47cf-b33d-725554d35368 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:13 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca6143d9-c963-47cf-b33d-725554d35368 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b Jul 22 12:17:13 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d6e09d43-0eb7-4c73-a687-730c0a592c76 tempest-VolumesActionsTest-1474808239 None] Acquiring lock "cinder-9cd6cff4-d838-42b9-8dbf-7b765d87a391" by "attach_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d6e09d43-0eb7-4c73-a687-730c0a592c76 tempest-VolumesActionsTest-1474808239 None] Lock "cinder-9cd6cff4-d838-42b9-8dbf-7b765d87a391" acquired by "attach_volume" :: waited 0.039s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:13 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d6e09d43-0eb7-4c73-a687-730c0a592c76 tempest-VolumesActionsTest-1474808239 None] Attaching volume 9cd6cff4-d838-42b9-8dbf-7b765d87a391 to instance 75ee3730-58cc-454e-8c23-9e442e319826 at mountpoint /dev/vdb on host None. Jul 22 12:17:14 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d6e09d43-0eb7-4c73-a687-730c0a592c76 tempest-VolumesActionsTest-1474808239 None] Attach volume completed successfully. Jul 22 12:17:14 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d6e09d43-0eb7-4c73-a687-730c0a592c76 tempest-VolumesActionsTest-1474808239 None] Lock "cinder-9cd6cff4-d838-42b9-8dbf-7b765d87a391" released by "attach_volume" :: held 0.207s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:14 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f2b9784f-ff2a-4f2e-9477-10f8b98ab266 tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca6143d9-c963-47cf-b33d-725554d35368 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b" returned: 0 in 0.653s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:14 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-f2b9784f-ff2a-4f2e-9477-10f8b98ab266 tempest-VolumesSnapshotListTestJSON-2014240394 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b is being set with open permissions: ugo+rw Jul 22 12:17:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f2b9784f-ff2a-4f2e-9477-10f8b98ab266 tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:14 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b Jul 22 12:17:14 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:14 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a0bfc398-85e8-494c-b45b-fe81b491e5ee tempest-VolumesActionsTest-1474808239 None] Acquiring lock "cinder-9cd6cff4-d838-42b9-8dbf-7b765d87a391-detach_volume" by "detach_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:14 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a0bfc398-85e8-494c-b45b-fe81b491e5ee tempest-VolumesActionsTest-1474808239 None] Lock "cinder-9cd6cff4-d838-42b9-8dbf-7b765d87a391-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:14 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-a0bfc398-85e8-494c-b45b-fe81b491e5ee tempest-VolumesActionsTest-1474808239 None] Detaching volume 9cd6cff4-d838-42b9-8dbf-7b765d87a391 from instance 75ee3730-58cc-454e-8c23-9e442e319826. Jul 22 12:17:14 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-a0bfc398-85e8-494c-b45b-fe81b491e5ee tempest-VolumesActionsTest-1474808239 None] Detach volume completed successfully. Jul 22 12:17:14 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a0bfc398-85e8-494c-b45b-fe81b491e5ee tempest-VolumesActionsTest-1474808239 None] Lock "cinder-9cd6cff4-d838-42b9-8dbf-7b765d87a391-detach_volume" released by "detach_volume" :: held 0.172s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:14 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f2b9784f-ff2a-4f2e-9477-10f8b98ab266 tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b" returned: 0 in 0.455s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f2b9784f-ff2a-4f2e-9477-10f8b98ab266 tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:14 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.info Jul 22 12:17:14 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:15 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f2b9784f-ff2a-4f2e-9477-10f8b98ab266 tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.info" returned: 0 in 0.503s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:15 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-f2b9784f-ff2a-4f2e-9477-10f8b98ab266 tempest-VolumesSnapshotListTestJSON-2014240394 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.info is being set with open permissions: ugo+rw Jul 22 12:17:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f2b9784f-ff2a-4f2e-9477-10f8b98ab266 tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:15 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.info Jul 22 12:17:15 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:15 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f2b9784f-ff2a-4f2e-9477-10f8b98ab266 tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.info" returned: 0 in 0.463s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f2b9784f-ff2a-4f2e-9477-10f8b98ab266 tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.771s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:17:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.319s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:17:15 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2006610729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5cb5abc-7190-4f14-b042-7a92685c1f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd701e1fb0b4fafa99a87acf4e3ea02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:17:13Z,use_quota=True,user_id='2851e8dfaaae419e8cdb90b0578278cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:17:15 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Creating volume f5cb5abc-7190-4f14-b042-7a92685c1f4f {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:17:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:17:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:17:15 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:17:15 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:17:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:17:15 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:17:15 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:17:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f5cb5abc-7190-4f14-b042-7a92685c1f4f 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:15 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f5cb5abc-7190-4f14-b042-7a92685c1f4f 1073741824 Jul 22 12:17:15 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:15 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-f2b9784f-ff2a-4f2e-9477-10f8b98ab266 tempest-VolumesSnapshotListTestJSON-2014240394 None] Create snapshot completed successfully Jul 22 12:17:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e8abd3f3-d96a-4562-b7f1-06f193aab02b tempest-VolumesSnapshotListTestJSON-2014240394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:17:16 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f5cb5abc-7190-4f14-b042-7a92685c1f4f 1073741824" returned: 0 in 0.959s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f5cb5abc-7190-4f14-b042-7a92685c1f4f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:16 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f5cb5abc-7190-4f14-b042-7a92685c1f4f Jul 22 12:17:16 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:17 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f5cb5abc-7190-4f14-b042-7a92685c1f4f" returned: 0 in 0.443s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:17:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:17:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e8abd3f3-d96a-4562-b7f1-06f193aab02b tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.593s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:17:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-e8abd3f3-d96a-4562-b7f1-06f193aab02b tempest-VolumesSnapshotListTestJSON-2014240394 None] Creating offline snapshot 1296345e-6e64-464f-869d-b75f580b1c28 of volume ca6143d9-c963-47cf-b33d-725554d35368 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:17:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e142e2-06a4-4616-8972-819318752fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5cb5abc-7190-4f14-b042-7a92685c1f4f', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edee5988-d394-46cc-8be2-514f5264c471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:17 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1a57b1-cca9-4163-a177-79a5937d8106]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:17:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e8abd3f3-d96a-4562-b7f1-06f193aab02b tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:17 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Volume volume-f5cb5abc-7190-4f14-b042-7a92685c1f4f (f5cb5abc-7190-4f14-b042-7a92685c1f4f): created successfully Jul 22 12:17:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edee5988-d394-46cc-8be2-514f5264c471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Flow 'volume_create_manager' (af82c51a-e6ab-4fc4-866f-c373cde66f4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:17:17 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-7fb35a6d-d750-4e08-84b6-109ce36ac30f tempest-VolumesNegativeTest-42649051 None] Created volume successfully. Jul 22 12:17:17 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b Jul 22 12:17:17 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:17 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e8abd3f3-d96a-4562-b7f1-06f193aab02b tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b" returned: 0 in 0.476s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-e8abd3f3-d96a-4562-b7f1-06f193aab02b tempest-VolumesSnapshotListTestJSON-2014240394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca6143d9-c963-47cf-b33d-725554d35368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:17:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e8abd3f3-d96a-4562-b7f1-06f193aab02b tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:17 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28 1G Jul 22 12:17:17 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:18 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e8abd3f3-d96a-4562-b7f1-06f193aab02b tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28 1G" returned: 0 in 0.623s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e8abd3f3-d96a-4562-b7f1-06f193aab02b tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:18 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28 Jul 22 12:17:18 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:18 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e8abd3f3-d96a-4562-b7f1-06f193aab02b tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28" returned: 0 in 0.492s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:18 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-e8abd3f3-d96a-4562-b7f1-06f193aab02b tempest-VolumesSnapshotListTestJSON-2014240394 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28 is being set with open permissions: ugo+rw Jul 22 12:17:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e8abd3f3-d96a-4562-b7f1-06f193aab02b tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:18 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28 Jul 22 12:17:18 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:19 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e8abd3f3-d96a-4562-b7f1-06f193aab02b tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28" returned: 0 in 0.361s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e8abd3f3-d96a-4562-b7f1-06f193aab02b tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.119s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:17:19 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e8abd3f3-d96a-4562-b7f1-06f193aab02b tempest-VolumesSnapshotListTestJSON-2014240394 None] Create snapshot completed successfully Jul 22 12:17:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-98e0f295-4ef0-430d-bc96-c8e875481511 tempest-VolumesSnapshotListTestJSON-2014240394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:17:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-98e0f295-4ef0-430d-bc96-c8e875481511 tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:17:20 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-98e0f295-4ef0-430d-bc96-c8e875481511 tempest-VolumesSnapshotListTestJSON-2014240394 None] Creating offline snapshot 1469d1a5-7009-489f-b3a3-896bbb4ea806 of volume ca6143d9-c963-47cf-b33d-725554d35368 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:17:20 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7b2b14-4c78-40b1-a8e0-855b1fbecfe0]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:17:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-98e0f295-4ef0-430d-bc96-c8e875481511 tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:20 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28 Jul 22 12:17:20 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:20 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-98e0f295-4ef0-430d-bc96-c8e875481511 tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28" returned: 0 in 0.652s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:20 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-98e0f295-4ef0-430d-bc96-c8e875481511 tempest-VolumesSnapshotListTestJSON-2014240394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca6143d9-c963-47cf-b33d-725554d35368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:17:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-98e0f295-4ef0-430d-bc96-c8e875481511 tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1469d1a5-7009-489f-b3a3-896bbb4ea806 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:20 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1469d1a5-7009-489f-b3a3-896bbb4ea806 1G Jul 22 12:17:20 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:21 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-98e0f295-4ef0-430d-bc96-c8e875481511 tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1469d1a5-7009-489f-b3a3-896bbb4ea806 1G" returned: 0 in 0.753s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-98e0f295-4ef0-430d-bc96-c8e875481511 tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1469d1a5-7009-489f-b3a3-896bbb4ea806 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:21 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1469d1a5-7009-489f-b3a3-896bbb4ea806 Jul 22 12:17:21 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:22 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-98e0f295-4ef0-430d-bc96-c8e875481511 tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1469d1a5-7009-489f-b3a3-896bbb4ea806" returned: 0 in 0.352s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:22 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-98e0f295-4ef0-430d-bc96-c8e875481511 tempest-VolumesSnapshotListTestJSON-2014240394 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1469d1a5-7009-489f-b3a3-896bbb4ea806 is being set with open permissions: ugo+rw Jul 22 12:17:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-98e0f295-4ef0-430d-bc96-c8e875481511 tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1469d1a5-7009-489f-b3a3-896bbb4ea806 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:22 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1469d1a5-7009-489f-b3a3-896bbb4ea806 Jul 22 12:17:22 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:22 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-98e0f295-4ef0-430d-bc96-c8e875481511 tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1469d1a5-7009-489f-b3a3-896bbb4ea806" returned: 0 in 0.481s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-98e0f295-4ef0-430d-bc96-c8e875481511 tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.472s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:17:22 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-98e0f295-4ef0-430d-bc96-c8e875481511 tempest-VolumesSnapshotListTestJSON-2014240394 None] Create snapshot completed successfully Jul 22 12:17:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:17:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:17:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:17:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:17:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:17:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:17:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:24 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:17:24 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] Acquiring lock "cinder-1469d1a5-7009-489f-b3a3-896bbb4ea806-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "cinder-1469d1a5-7009-489f-b3a3-896bbb4ea806-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] Acquiring lock "cinder-quobyte-ca6143d9-c963-47cf-b33d-725554d35368" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "cinder-quobyte-ca6143d9-c963-47cf-b33d-725554d35368" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] Acquiring lock "cinder-quobyte-1469d1a5-7009-489f-b3a3-896bbb4ea806" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "cinder-quobyte-1469d1a5-7009-489f-b3a3-896bbb4ea806" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] Deleting offline snapshot 1469d1a5-7009-489f-b3a3-896bbb4ea806 of volume ca6143d9-c963-47cf-b33d-725554d35368 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:17:25 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] snapshot_file for this snap is: volume-ca6143d9-c963-47cf-b33d-725554d35368.1469d1a5-7009-489f-b3a3-896bbb4ea806 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:17:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.653s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:25 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:17:25 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:17:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread count: 28 {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:17:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread info: [<_MainThread(MainThread, started 137793405739136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:17:25 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43a04db-3376-4fc8-baae-d7dd77ae9cfb]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:17:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1469d1a5-7009-489f-b3a3-896bbb4ea806 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:25 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1469d1a5-7009-489f-b3a3-896bbb4ea806 Jul 22 12:17:25 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:25 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1469d1a5-7009-489f-b3a3-896bbb4ea806" returned: 0 in 0.589s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca6143d9-c963-47cf-b33d-725554d35368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:17:25 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d5740b-a3d0-4786-b423-fefbb3a1bd43]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:17:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:25 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28 Jul 22 12:17:25 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:26 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28" returned: 0 in 0.702s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca6143d9-c963-47cf-b33d-725554d35368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:17:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1469d1a5-7009-489f-b3a3-896bbb4ea806 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:26 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1469d1a5-7009-489f-b3a3-896bbb4ea806 Jul 22 12:17:26 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:27 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1469d1a5-7009-489f-b3a3-896bbb4ea806" returned: 0 in 1.315s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1469d1a5-7009-489f-b3a3-896bbb4ea806 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:27 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1469d1a5-7009-489f-b3a3-896bbb4ea806 Jul 22 12:17:27 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:28 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1469d1a5-7009-489f-b3a3-896bbb4ea806" returned: 0 in 0.713s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "cinder-quobyte-1469d1a5-7009-489f-b3a3-896bbb4ea806" released by "_delete_snapshot" :: held 3.601s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "cinder-quobyte-ca6143d9-c963-47cf-b33d-725554d35368" released by "delete_snapshot" :: held 3.671s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:28 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] Created reservations ['c4dc58ae-d5fc-454f-8492-4f5d9807f842', '1c0f269d-0195-43f3-b21d-03ac32dd8ae6', 'f6b36408-28e2-4ad1-95fa-8728f29d4c24', '95801264-6ced-4a5f-80d8-bfc2782259c8'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:17:28 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] Delete snapshot completed successfully. Jul 22 12:17:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-61761233-9e6d-48da-8661-9bf1fea5179b tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "cinder-1469d1a5-7009-489f-b3a3-896bbb4ea806-delete_snapshot" released by "delete_snapshot" :: held 4.064s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] Acquiring lock "cinder-1296345e-6e64-464f-869d-b75f580b1c28-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "cinder-1296345e-6e64-464f-869d-b75f580b1c28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] Acquiring lock "cinder-quobyte-ca6143d9-c963-47cf-b33d-725554d35368" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "cinder-quobyte-ca6143d9-c963-47cf-b33d-725554d35368" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] Acquiring lock "cinder-quobyte-1296345e-6e64-464f-869d-b75f580b1c28" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "cinder-quobyte-1296345e-6e64-464f-869d-b75f580b1c28" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] Deleting offline snapshot 1296345e-6e64-464f-869d-b75f580b1c28 of volume ca6143d9-c963-47cf-b33d-725554d35368 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:17:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] snapshot_file for this snap is: volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:17:30 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[2337960d-41a0-432a-873e-81ee09e5ec31]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:17:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:30 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28 Jul 22 12:17:30 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Flow 'volume_create_manager' (f3577ce7-3a48-426c-9fc7-d39f032238b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98add6e-0c9b-4215-975e-880cca81be9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98add6e-0c9b-4215-975e-880cca81be9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1463611160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3551ee-addb-47fa-9d89-d66947fbbdc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c4aa921baf4991aaba1f0984260946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:17:31Z,use_quota=True,user_id='30a48a0ee1c540768971b344c3e84312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2fd00d-a2eb-4027-9138-4f9ab8f08ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2fd00d-a2eb-4027-9138-4f9ab8f08ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a00a5d-b088-4976-9ba0-bcab355505cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a00a5d-b088-4976-9ba0-bcab355505cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae3551ee-addb-47fa-9d89-d66947fbbdc9', 'volume_name': 'volume-ae3551ee-addb-47fa-9d89-d66947fbbdc9', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c275c87-aea4-4289-ab3a-757367c03034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c275c87-aea4-4289-ab3a-757367c03034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd55fbfe-64df-4a84-8800-d4763153963f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:31 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Volume ae3551ee-addb-47fa-9d89-d66947fbbdc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae3551ee-addb-47fa-9d89-d66947fbbdc9', 'volume_size': 1} Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1463611160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3551ee-addb-47fa-9d89-d66947fbbdc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c4aa921baf4991aaba1f0984260946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:17:31Z,use_quota=True,user_id='30a48a0ee1c540768971b344c3e84312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Creating volume ae3551ee-addb-47fa-9d89-d66947fbbdc9 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:17:31 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ae3551ee-addb-47fa-9d89-d66947fbbdc9 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:31 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28" returned: 0 in 1.348s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:31 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ae3551ee-addb-47fa-9d89-d66947fbbdc9 1073741824 Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca6143d9-c963-47cf-b33d-725554d35368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:17:31 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e061a627-dc74-440c-bbc1-aff0024d9ba8]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:17:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:31 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b Jul 22 12:17:31 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:32 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b" returned: 0 in 0.757s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca6143d9-c963-47cf-b33d-725554d35368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:17:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:32 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28 Jul 22 12:17:32 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:32 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ae3551ee-addb-47fa-9d89-d66947fbbdc9 1073741824" returned: 0 in 1.163s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ae3551ee-addb-47fa-9d89-d66947fbbdc9 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:32 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ae3551ee-addb-47fa-9d89-d66947fbbdc9 Jul 22 12:17:32 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:32 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ae3551ee-addb-47fa-9d89-d66947fbbdc9" returned: 0 in 0.311s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:17:32 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:17:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28" returned: 0 in 0.602s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd55fbfe-64df-4a84-8800-d4763153963f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae3551ee-addb-47fa-9d89-d66947fbbdc9', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de349b7-88fa-440f-bd6e-dff167e84d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:32 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28 Jul 22 12:17:32 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:32 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Volume volume-ae3551ee-addb-47fa-9d89-d66947fbbdc9 (ae3551ee-addb-47fa-9d89-d66947fbbdc9): created successfully Jul 22 12:17:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de349b7-88fa-440f-bd6e-dff167e84d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Flow 'volume_create_manager' (f3577ce7-3a48-426c-9fc7-d39f032238b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:17:32 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d6fd0de9-84b9-4ad9-8eda-2d568bd8f693 tempest-VolumesActionsTest-2008170282 None] Created volume successfully. Jul 22 12:17:33 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.1296345e-6e64-464f-869d-b75f580b1c28" returned: 0 in 0.288s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "cinder-quobyte-1296345e-6e64-464f-869d-b75f580b1c28" released by "_delete_snapshot" :: held 3.310s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "cinder-quobyte-ca6143d9-c963-47cf-b33d-725554d35368" released by "delete_snapshot" :: held 3.379s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:33 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] Created reservations ['7cd61bb2-d866-4c07-87c4-8b1fd3290373', '3b74c3b9-2a38-481f-a39c-a49255983a7f', '5964aa08-d027-4c40-a4d6-4ed56f41fda4', 'b42922fc-5f9a-40b4-85fe-cea74b03448d'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:17:33 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] Delete snapshot completed successfully. Jul 22 12:17:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20463972-0616-4ef0-ad62-da11ad6e8452 tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "cinder-1296345e-6e64-464f-869d-b75f580b1c28-delete_snapshot" released by "delete_snapshot" :: held 3.607s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-aec0bee2-844c-4958-9ad9-1b13c6fc0dcc tempest-VolumesActionsTest-2008170282 None] Acquiring lock "cinder-ae3551ee-addb-47fa-9d89-d66947fbbdc9" by "attach_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-aec0bee2-844c-4958-9ad9-1b13c6fc0dcc tempest-VolumesActionsTest-2008170282 None] Lock "cinder-ae3551ee-addb-47fa-9d89-d66947fbbdc9" acquired by "attach_volume" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:34 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-aec0bee2-844c-4958-9ad9-1b13c6fc0dcc tempest-VolumesActionsTest-2008170282 None] Attaching volume ae3551ee-addb-47fa-9d89-d66947fbbdc9 to instance bccd78f8-a697-4ba8-bebe-c701ae061175 at mountpoint /dev/vdb on host None. Jul 22 12:17:34 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-aec0bee2-844c-4958-9ad9-1b13c6fc0dcc tempest-VolumesActionsTest-2008170282 None] Attach volume completed successfully. Jul 22 12:17:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-aec0bee2-844c-4958-9ad9-1b13c6fc0dcc tempest-VolumesActionsTest-2008170282 None] Lock "cinder-ae3551ee-addb-47fa-9d89-d66947fbbdc9" released by "attach_volume" :: held 0.140s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9c484d75-ed5a-46a8-ba47-9b8c0bd2439d tempest-VolumesSnapshotListTestJSON-2014240394 None] Acquiring lock "cinder-d74ff57c-e503-4ace-9816-17f5ffdf621b-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9c484d75-ed5a-46a8-ba47-9b8c0bd2439d tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "cinder-d74ff57c-e503-4ace-9816-17f5ffdf621b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9c484d75-ed5a-46a8-ba47-9b8c0bd2439d tempest-VolumesSnapshotListTestJSON-2014240394 None] Acquiring lock "cinder-quobyte-ca6143d9-c963-47cf-b33d-725554d35368" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9c484d75-ed5a-46a8-ba47-9b8c0bd2439d tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "cinder-quobyte-ca6143d9-c963-47cf-b33d-725554d35368" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9c484d75-ed5a-46a8-ba47-9b8c0bd2439d tempest-VolumesSnapshotListTestJSON-2014240394 None] Acquiring lock "cinder-quobyte-d74ff57c-e503-4ace-9816-17f5ffdf621b" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9c484d75-ed5a-46a8-ba47-9b8c0bd2439d tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "cinder-quobyte-d74ff57c-e503-4ace-9816-17f5ffdf621b" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-9c484d75-ed5a-46a8-ba47-9b8c0bd2439d tempest-VolumesSnapshotListTestJSON-2014240394 None] Deleting offline snapshot d74ff57c-e503-4ace-9816-17f5ffdf621b of volume ca6143d9-c963-47cf-b33d-725554d35368 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:17:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-9c484d75-ed5a-46a8-ba47-9b8c0bd2439d tempest-VolumesSnapshotListTestJSON-2014240394 None] snapshot_file for this snap is: volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:17:34 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[431e3d50-ed00-480f-87cd-ac106b97fa6a]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:17:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9c484d75-ed5a-46a8-ba47-9b8c0bd2439d tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:35 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b Jul 22 12:17:35 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:35 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9c484d75-ed5a-46a8-ba47-9b8c0bd2439d tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b" returned: 0 in 0.685s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-9c484d75-ed5a-46a8-ba47-9b8c0bd2439d tempest-VolumesSnapshotListTestJSON-2014240394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca6143d9-c963-47cf-b33d-725554d35368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:17:35 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[399509e1-83ba-49e8-a209-4eb88356ae9c]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:17:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9c484d75-ed5a-46a8-ba47-9b8c0bd2439d tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:35 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d125c47d-3bfb-4c16-b1f6-be1538c3303a tempest-VolumesActionsTest-801594599 None] Terminate volume connection completed successfully. Jul 22 12:17:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e201f1c4-8d5d-4063-b830-eb7f97344af7 tempest-VolumesActionsTest-1474808239 None] Acquiring lock "cinder-9cd6cff4-d838-42b9-8dbf-7b765d87a391" by "attach_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d125c47d-3bfb-4c16-b1f6-be1538c3303a tempest-VolumesActionsTest-801594599 None] Acquiring lock "cinder-ae3551ee-addb-47fa-9d89-d66947fbbdc9-detach_volume" by "detach_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e201f1c4-8d5d-4063-b830-eb7f97344af7 tempest-VolumesActionsTest-1474808239 None] Lock "cinder-9cd6cff4-d838-42b9-8dbf-7b765d87a391" acquired by "attach_volume" :: waited 0.060s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:35 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368 Jul 22 12:17:35 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d125c47d-3bfb-4c16-b1f6-be1538c3303a tempest-VolumesActionsTest-801594599 None] Lock "cinder-ae3551ee-addb-47fa-9d89-d66947fbbdc9-detach_volume" acquired by "detach_volume" :: waited 0.064s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:36 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d125c47d-3bfb-4c16-b1f6-be1538c3303a tempest-VolumesActionsTest-801594599 None] Detaching volume ae3551ee-addb-47fa-9d89-d66947fbbdc9 from instance bccd78f8-a697-4ba8-bebe-c701ae061175. Jul 22 12:17:36 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e201f1c4-8d5d-4063-b830-eb7f97344af7 tempest-VolumesActionsTest-1474808239 None] Attaching volume 9cd6cff4-d838-42b9-8dbf-7b765d87a391 to instance e2390ac9-c4e6-4e6a-b702-164977241e30 at mountpoint /dev/vdb on host None. Jul 22 12:17:36 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e201f1c4-8d5d-4063-b830-eb7f97344af7 tempest-VolumesActionsTest-1474808239 None] Attach volume completed successfully. Jul 22 12:17:36 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d125c47d-3bfb-4c16-b1f6-be1538c3303a tempest-VolumesActionsTest-801594599 None] Detach volume completed successfully. Jul 22 12:17:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e201f1c4-8d5d-4063-b830-eb7f97344af7 tempest-VolumesActionsTest-1474808239 None] Lock "cinder-9cd6cff4-d838-42b9-8dbf-7b765d87a391" released by "attach_volume" :: held 0.249s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d125c47d-3bfb-4c16-b1f6-be1538c3303a tempest-VolumesActionsTest-801594599 None] Lock "cinder-ae3551ee-addb-47fa-9d89-d66947fbbdc9-detach_volume" released by "detach_volume" :: held 0.221s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:36 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f808c305-02c9-4277-bf5a-80947865f2af tempest-VolumesActionsTest-2008170282 None] Acquiring lock "cinder-ae3551ee-addb-47fa-9d89-d66947fbbdc9-detach_volume" by "detach_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9c484d75-ed5a-46a8-ba47-9b8c0bd2439d tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368" returned: 0 in 1.063s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9c484d75-ed5a-46a8-ba47-9b8c0bd2439d tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2e132c6b-e7d1-465c-83d9-2c68c6ccd77c tempest-VolumesActionsTest-1474808239 None] Acquiring lock "cinder-9cd6cff4-d838-42b9-8dbf-7b765d87a391-detach_volume" by "detach_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:36 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b Jul 22 12:17:36 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f808c305-02c9-4277-bf5a-80947865f2af tempest-VolumesActionsTest-2008170282 None] Lock "cinder-ae3551ee-addb-47fa-9d89-d66947fbbdc9-detach_volume" acquired by "detach_volume" :: waited 0.129s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:36 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-f808c305-02c9-4277-bf5a-80947865f2af tempest-VolumesActionsTest-2008170282 None] Volume detach called, but volume not attached. Jul 22 12:17:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2e132c6b-e7d1-465c-83d9-2c68c6ccd77c tempest-VolumesActionsTest-1474808239 None] Lock "cinder-9cd6cff4-d838-42b9-8dbf-7b765d87a391-detach_volume" acquired by "detach_volume" :: waited 0.075s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:36 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-2e132c6b-e7d1-465c-83d9-2c68c6ccd77c tempest-VolumesActionsTest-1474808239 None] Detaching volume 9cd6cff4-d838-42b9-8dbf-7b765d87a391 from instance e2390ac9-c4e6-4e6a-b702-164977241e30. Jul 22 12:17:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f808c305-02c9-4277-bf5a-80947865f2af tempest-VolumesActionsTest-2008170282 None] Lock "cinder-ae3551ee-addb-47fa-9d89-d66947fbbdc9-detach_volume" released by "detach_volume" :: held 0.079s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:37 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-2e132c6b-e7d1-465c-83d9-2c68c6ccd77c tempest-VolumesActionsTest-1474808239 None] Detach volume completed successfully. Jul 22 12:17:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2e132c6b-e7d1-465c-83d9-2c68c6ccd77c tempest-VolumesActionsTest-1474808239 None] Lock "cinder-9cd6cff4-d838-42b9-8dbf-7b765d87a391-detach_volume" released by "detach_volume" :: held 0.238s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6ce3180c-567d-4bbe-868c-7124653034c8 tempest-VolumesActionsTest-2008170282 None] Acquiring lock "cinder-ae3551ee-addb-47fa-9d89-d66947fbbdc9-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6ce3180c-567d-4bbe-868c-7124653034c8 tempest-VolumesActionsTest-2008170282 None] Lock "cinder-ae3551ee-addb-47fa-9d89-d66947fbbdc9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6ce3180c-567d-4bbe-868c-7124653034c8 tempest-VolumesActionsTest-2008170282 None] Acquiring lock "cinder-quobyte-ae3551ee-addb-47fa-9d89-d66947fbbdc9" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6ce3180c-567d-4bbe-868c-7124653034c8 tempest-VolumesActionsTest-2008170282 None] Lock "cinder-quobyte-ae3551ee-addb-47fa-9d89-d66947fbbdc9" acquired by "delete_volume" :: waited 0.049s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:37 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[757ef077-60aa-4bb9-a5ac-6817ffc0b33b]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:17:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6ce3180c-567d-4bbe-868c-7124653034c8 tempest-VolumesActionsTest-2008170282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ae3551ee-addb-47fa-9d89-d66947fbbdc9 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:37 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9c484d75-ed5a-46a8-ba47-9b8c0bd2439d tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b" returned: 0 in 1.143s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9c484d75-ed5a-46a8-ba47-9b8c0bd2439d tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:37 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b Jul 22 12:17:37 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:38 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ae3551ee-addb-47fa-9d89-d66947fbbdc9 Jul 22 12:17:38 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:38 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9c484d75-ed5a-46a8-ba47-9b8c0bd2439d tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368.d74ff57c-e503-4ace-9816-17f5ffdf621b" returned: 0 in 0.544s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:38 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9c484d75-ed5a-46a8-ba47-9b8c0bd2439d tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "cinder-quobyte-d74ff57c-e503-4ace-9816-17f5ffdf621b" released by "_delete_snapshot" :: held 3.878s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:38 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9c484d75-ed5a-46a8-ba47-9b8c0bd2439d tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "cinder-quobyte-ca6143d9-c963-47cf-b33d-725554d35368" released by "delete_snapshot" :: held 3.940s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:38 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-9c484d75-ed5a-46a8-ba47-9b8c0bd2439d tempest-VolumesSnapshotListTestJSON-2014240394 None] Created reservations ['62540cbe-d198-434f-8d37-5aee4492f77a', '6299c2ca-2ed8-41ae-80bd-247551742f6f', '3118152b-2b7c-4bf0-899b-0a53a43008d5', '4794c37c-46b2-4f4d-be2d-0c5c2364d231'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:17:38 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-9c484d75-ed5a-46a8-ba47-9b8c0bd2439d tempest-VolumesSnapshotListTestJSON-2014240394 None] Delete snapshot completed successfully. Jul 22 12:17:38 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9c484d75-ed5a-46a8-ba47-9b8c0bd2439d tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "cinder-d74ff57c-e503-4ace-9816-17f5ffdf621b-delete_snapshot" released by "delete_snapshot" :: held 4.325s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:38 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6ce3180c-567d-4bbe-868c-7124653034c8 tempest-VolumesActionsTest-2008170282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ae3551ee-addb-47fa-9d89-d66947fbbdc9" returned: 0 in 1.185s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6ce3180c-567d-4bbe-868c-7124653034c8 tempest-VolumesActionsTest-2008170282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ae3551ee-addb-47fa-9d89-d66947fbbdc9 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:38 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ae3551ee-addb-47fa-9d89-d66947fbbdc9 Jul 22 12:17:38 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:39 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-770ea8bb-1965-45c6-bf53-7dc667201921 tempest-VolumesSnapshotListTestJSON-2014240394 None] Acquiring lock "cinder-ca6143d9-c963-47cf-b33d-725554d35368-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6ce3180c-567d-4bbe-868c-7124653034c8 tempest-VolumesActionsTest-2008170282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ae3551ee-addb-47fa-9d89-d66947fbbdc9" returned: 0 in 0.443s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6ce3180c-567d-4bbe-868c-7124653034c8 tempest-VolumesActionsTest-2008170282 None] Lock "cinder-quobyte-ae3551ee-addb-47fa-9d89-d66947fbbdc9" released by "delete_volume" :: held 1.705s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-770ea8bb-1965-45c6-bf53-7dc667201921 tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "cinder-ca6143d9-c963-47cf-b33d-725554d35368-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-770ea8bb-1965-45c6-bf53-7dc667201921 tempest-VolumesSnapshotListTestJSON-2014240394 None] Acquiring lock "cinder-quobyte-ca6143d9-c963-47cf-b33d-725554d35368" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-770ea8bb-1965-45c6-bf53-7dc667201921 tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "cinder-quobyte-ca6143d9-c963-47cf-b33d-725554d35368" acquired by "delete_volume" :: waited 0.028s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:39 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-6ce3180c-567d-4bbe-868c-7124653034c8 tempest-VolumesActionsTest-2008170282 None] Created reservations ['72fd43bb-32f4-4afa-88a8-d0d9ef1b6b86', '8160495e-b1bd-4aaa-a790-5a248d02ee76', '7c3aedc2-c0ba-4f08-abf9-0940de624690', 'bb48d9d7-3272-4925-8e84-f2af2c02fc35'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:17:39 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c5f2aa-f708-453d-905f-1b7807bcb8a5]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:17:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-770ea8bb-1965-45c6-bf53-7dc667201921 tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6ce3180c-567d-4bbe-868c-7124653034c8 tempest-VolumesActionsTest-2008170282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:17:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6ce3180c-567d-4bbe-868c-7124653034c8 tempest-VolumesActionsTest-2008170282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:17:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6ce3180c-567d-4bbe-868c-7124653034c8 tempest-VolumesActionsTest-2008170282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:17:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6ce3180c-567d-4bbe-868c-7124653034c8 tempest-VolumesActionsTest-2008170282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:17:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6ce3180c-567d-4bbe-868c-7124653034c8 tempest-VolumesActionsTest-2008170282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:17:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6ce3180c-567d-4bbe-868c-7124653034c8 tempest-VolumesActionsTest-2008170282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:39 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368 Jul 22 12:17:39 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:39 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:17:39 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:40 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6ce3180c-567d-4bbe-868c-7124653034c8 tempest-VolumesActionsTest-2008170282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.392s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:40 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-6ce3180c-567d-4bbe-868c-7124653034c8 tempest-VolumesActionsTest-2008170282 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:17:40 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-6ce3180c-567d-4bbe-868c-7124653034c8 tempest-VolumesActionsTest-2008170282 None] Deleted volume successfully. Jul 22 12:17:40 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-770ea8bb-1965-45c6-bf53-7dc667201921 tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368" returned: 0 in 0.544s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-770ea8bb-1965-45c6-bf53-7dc667201921 tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:40 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368 Jul 22 12:17:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6ce3180c-567d-4bbe-868c-7124653034c8 tempest-VolumesActionsTest-2008170282 None] Lock "cinder-ae3551ee-addb-47fa-9d89-d66947fbbdc9-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:40 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:40 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-770ea8bb-1965-45c6-bf53-7dc667201921 tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ca6143d9-c963-47cf-b33d-725554d35368" returned: 0 in 0.420s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-770ea8bb-1965-45c6-bf53-7dc667201921 tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "cinder-quobyte-ca6143d9-c963-47cf-b33d-725554d35368" released by "delete_volume" :: held 1.053s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:40 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-770ea8bb-1965-45c6-bf53-7dc667201921 tempest-VolumesSnapshotListTestJSON-2014240394 None] Created reservations ['0118bf5b-80e2-4522-833e-7fb9b4a20de1', '0aad977d-1d7f-4696-b3d8-bf7dce1419d0', '4feb8b26-74af-4a94-bcd8-f3275e14a179', '026b4227-0253-47f5-9122-4bbddc08044e'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:17:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-770ea8bb-1965-45c6-bf53-7dc667201921 tempest-VolumesSnapshotListTestJSON-2014240394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:17:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-770ea8bb-1965-45c6-bf53-7dc667201921 tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:17:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-770ea8bb-1965-45c6-bf53-7dc667201921 tempest-VolumesSnapshotListTestJSON-2014240394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:17:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-770ea8bb-1965-45c6-bf53-7dc667201921 tempest-VolumesSnapshotListTestJSON-2014240394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:17:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-770ea8bb-1965-45c6-bf53-7dc667201921 tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:17:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-770ea8bb-1965-45c6-bf53-7dc667201921 tempest-VolumesSnapshotListTestJSON-2014240394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:40 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:17:40 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:41 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-770ea8bb-1965-45c6-bf53-7dc667201921 tempest-VolumesSnapshotListTestJSON-2014240394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.565s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:41 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-770ea8bb-1965-45c6-bf53-7dc667201921 tempest-VolumesSnapshotListTestJSON-2014240394 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:17:41 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-770ea8bb-1965-45c6-bf53-7dc667201921 tempest-VolumesSnapshotListTestJSON-2014240394 None] Deleted volume successfully. Jul 22 12:17:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-770ea8bb-1965-45c6-bf53-7dc667201921 tempest-VolumesSnapshotListTestJSON-2014240394 None] Lock "cinder-ca6143d9-c963-47cf-b33d-725554d35368-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:43 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:17:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Flow 'volume_create_manager' (c5dbc657-307f-4f5b-8ecf-19494697d7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:17:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85d4a4d-25ac-4973-8c5f-daea8c344bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85d4a4d-25ac-4973-8c5f-daea8c344bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1520760038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb0c1d5-598b-4c67-95e5-d26e7667f12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c4aa921baf4991aaba1f0984260946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:17:44Z,use_quota=True,user_id='30a48a0ee1c540768971b344c3e84312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f76c72-499c-40ba-a38a-ca816b59ac07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f76c72-499c-40ba-a38a-ca816b59ac07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0d23ff-8f6a-440d-bd02-1134b9b2703e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0d23ff-8f6a-440d-bd02-1134b9b2703e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fb0c1d5-598b-4c67-95e5-d26e7667f12b', 'volume_name': 'volume-5fb0c1d5-598b-4c67-95e5-d26e7667f12b', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277f0875-fe0a-4c9e-b8b4-d9369d989398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277f0875-fe0a-4c9e-b8b4-d9369d989398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297fb91e-e3b8-43a4-9397-05095bbd1bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:44 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Volume 5fb0c1d5-598b-4c67-95e5-d26e7667f12b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fb0c1d5-598b-4c67-95e5-d26e7667f12b', 'volume_size': 1} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1520760038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb0c1d5-598b-4c67-95e5-d26e7667f12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c4aa921baf4991aaba1f0984260946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:17:44Z,use_quota=True,user_id='30a48a0ee1c540768971b344c3e84312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Creating volume 5fb0c1d5-598b-4c67-95e5-d26e7667f12b {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:17:44 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fb0c1d5-598b-4c67-95e5-d26e7667f12b 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:44 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fb0c1d5-598b-4c67-95e5-d26e7667f12b 1073741824 Jul 22 12:17:44 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d5f7b2fe-060c-4dc4-8b2e-0026967b8e1d tempest-VolumesActionsTest-1474808239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:17:44 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fb0c1d5-598b-4c67-95e5-d26e7667f12b 1073741824" returned: 0 in 0.570s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fb0c1d5-598b-4c67-95e5-d26e7667f12b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:44 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fb0c1d5-598b-4c67-95e5-d26e7667f12b Jul 22 12:17:44 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:44 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fb0c1d5-598b-4c67-95e5-d26e7667f12b" returned: 0 in 0.258s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d5f7b2fe-060c-4dc4-8b2e-0026967b8e1d tempest-VolumesActionsTest-1474808239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.421s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297fb91e-e3b8-43a4-9397-05095bbd1bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fb0c1d5-598b-4c67-95e5-d26e7667f12b', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad73fa79-5370-4a86-a174-a295a9737f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[9047f4da-aa48-4c51-9498-82391db1530c]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5f7b2fe-060c-4dc4-8b2e-0026967b8e1d tempest-VolumesActionsTest-1474808239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:44 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Volume volume-5fb0c1d5-598b-4c67-95e5-d26e7667f12b (5fb0c1d5-598b-4c67-95e5-d26e7667f12b): created successfully Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad73fa79-5370-4a86-a174-a295a9737f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:44 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Flow 'volume_create_manager' (c5dbc657-307f-4f5b-8ecf-19494697d7b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:17:44 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-2ec7b64b-1745-40cb-a76e-6b1bb8784b57 tempest-VolumesActionsTest-2008170282 None] Created volume successfully. Jul 22 12:17:45 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 Jul 22 12:17:45 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:45 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5f7b2fe-060c-4dc4-8b2e-0026967b8e1d tempest-VolumesActionsTest-1474808239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391" returned: 0 in 0.452s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:45 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[9860f562-3695-4c7f-88b5-41d3eb72d148]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:17:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5f7b2fe-060c-4dc4-8b2e-0026967b8e1d tempest-VolumesActionsTest-1474808239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:45 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 Jul 22 12:17:45 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:45 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5f7b2fe-060c-4dc4-8b2e-0026967b8e1d tempest-VolumesActionsTest-1474808239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391" returned: 0 in 0.396s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5f7b2fe-060c-4dc4-8b2e-0026967b8e1d tempest-VolumesActionsTest-1474808239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 /opt/stack/data/cinder/conversion/9cd6cff4-d838-42b9-8dbf-7b765d87a391.temp_image.649fdce8-86e8-4897-8a36-2a22e51a8a50ba93hx77.img {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:45 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 /opt/stack/data/cinder/conversion/9cd6cff4-d838-42b9-8dbf-7b765d87a391.temp_image.649fdce8-86e8-4897-8a36-2a22e51a8a50ba93hx77.img Jul 22 12:17:45 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:46 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-33c705fd-6267-482a-80a2-813db4539488 tempest-VolumesActionsTest-801594599 None] Acquiring lock "cinder-5fb0c1d5-598b-4c67-95e5-d26e7667f12b-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:46 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-33c705fd-6267-482a-80a2-813db4539488 tempest-VolumesActionsTest-801594599 None] Lock "cinder-5fb0c1d5-598b-4c67-95e5-d26e7667f12b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:46 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-33c705fd-6267-482a-80a2-813db4539488 tempest-VolumesActionsTest-801594599 None] Acquiring lock "cinder-quobyte-5fb0c1d5-598b-4c67-95e5-d26e7667f12b" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:46 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-33c705fd-6267-482a-80a2-813db4539488 tempest-VolumesActionsTest-801594599 None] Lock "cinder-quobyte-5fb0c1d5-598b-4c67-95e5-d26e7667f12b" acquired by "delete_volume" :: waited 0.039s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:46 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2de823-63ca-4405-8b71-2c66198a6222]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:17:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-33c705fd-6267-482a-80a2-813db4539488 tempest-VolumesActionsTest-801594599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fb0c1d5-598b-4c67-95e5-d26e7667f12b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:46 devstack sudo[97697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fb0c1d5-598b-4c67-95e5-d26e7667f12b Jul 22 12:17:46 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:47 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-33c705fd-6267-482a-80a2-813db4539488 tempest-VolumesActionsTest-801594599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fb0c1d5-598b-4c67-95e5-d26e7667f12b" returned: 0 in 0.950s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-33c705fd-6267-482a-80a2-813db4539488 tempest-VolumesActionsTest-801594599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fb0c1d5-598b-4c67-95e5-d26e7667f12b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:47 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fb0c1d5-598b-4c67-95e5-d26e7667f12b Jul 22 12:17:47 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:48 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-33c705fd-6267-482a-80a2-813db4539488 tempest-VolumesActionsTest-801594599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fb0c1d5-598b-4c67-95e5-d26e7667f12b" returned: 0 in 0.643s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-33c705fd-6267-482a-80a2-813db4539488 tempest-VolumesActionsTest-801594599 None] Lock "cinder-quobyte-5fb0c1d5-598b-4c67-95e5-d26e7667f12b" released by "delete_volume" :: held 1.712s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:48 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-33c705fd-6267-482a-80a2-813db4539488 tempest-VolumesActionsTest-801594599 None] Created reservations ['ee59284c-4708-424e-a0af-893bf8cb4596', 'c9ca9875-0c6a-42a4-ae61-8d90ad2dd783', 'c35bce66-9b7c-43b0-8c0c-4f00ec0e5bc3', 'bd19a71c-902d-44f0-b351-cec6927226d1'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:17:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-33c705fd-6267-482a-80a2-813db4539488 tempest-VolumesActionsTest-801594599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:17:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-33c705fd-6267-482a-80a2-813db4539488 tempest-VolumesActionsTest-801594599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:17:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-33c705fd-6267-482a-80a2-813db4539488 tempest-VolumesActionsTest-801594599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:17:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-33c705fd-6267-482a-80a2-813db4539488 tempest-VolumesActionsTest-801594599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:17:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-33c705fd-6267-482a-80a2-813db4539488 tempest-VolumesActionsTest-801594599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:17:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-33c705fd-6267-482a-80a2-813db4539488 tempest-VolumesActionsTest-801594599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:48 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:17:48 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:48 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-33c705fd-6267-482a-80a2-813db4539488 tempest-VolumesActionsTest-801594599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.518s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:48 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-33c705fd-6267-482a-80a2-813db4539488 tempest-VolumesActionsTest-801594599 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:17:49 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-33c705fd-6267-482a-80a2-813db4539488 tempest-VolumesActionsTest-801594599 None] Deleted volume successfully. Jul 22 12:17:49 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-33c705fd-6267-482a-80a2-813db4539488 tempest-VolumesActionsTest-801594599 None] Lock "cinder-5fb0c1d5-598b-4c67-95e5-d26e7667f12b-delete_volume" released by "delete_volume" :: held 2.792s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:50 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:17:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Flow 'volume_create_manager' (6cd7c028-e3dd-4c79-8ee2-d0540ebecc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:17:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fa6e381-97a3-40d6-a938-18b882df0a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fa6e381-97a3-40d6-a938-18b882df0a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-648580667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21835d20-e236-447c-b31e-cb1941de071e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c4aa921baf4991aaba1f0984260946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:17:51Z,use_quota=True,user_id='30a48a0ee1c540768971b344c3e84312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f70f739b-1d1d-4caf-af32-d4d485c2dc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f70f739b-1d1d-4caf-af32-d4d485c2dc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5544c058-f111-4e73-ae02-985973f00595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5544c058-f111-4e73-ae02-985973f00595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21835d20-e236-447c-b31e-cb1941de071e', 'volume_name': 'volume-21835d20-e236-447c-b31e-cb1941de071e', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886e03b5-153b-4bbe-94a5-f22d9d9a4046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886e03b5-153b-4bbe-94a5-f22d9d9a4046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:17:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1fe3c4-99ec-43a6-8e2b-a5c515f4b1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:17:50 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Volume 21835d20-e236-447c-b31e-cb1941de071e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21835d20-e236-447c-b31e-cb1941de071e', 'volume_size': 1} Jul 22 12:17:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:17:51 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5f7b2fe-060c-4dc4-8b2e-0026967b8e1d tempest-VolumesActionsTest-1474808239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 /opt/stack/data/cinder/conversion/9cd6cff4-d838-42b9-8dbf-7b765d87a391.temp_image.649fdce8-86e8-4897-8a36-2a22e51a8a50ba93hx77.img" returned: 0 in 6.138s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:51 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e5de47-cf46-43cd-879a-91eb7073ec31]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:17:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5f7b2fe-060c-4dc4-8b2e-0026967b8e1d tempest-VolumesActionsTest-1474808239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:52 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 Jul 22 12:17:52 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:52 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-aa5980c4-4892-4158-a2cd-cda636f582e6 tempest-VolumesNegativeTest-42649051 None] Acquiring lock "cinder-f5cb5abc-7190-4f14-b042-7a92685c1f4f-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:52 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-aa5980c4-4892-4158-a2cd-cda636f582e6 tempest-VolumesNegativeTest-42649051 None] Lock "cinder-f5cb5abc-7190-4f14-b042-7a92685c1f4f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:52 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-aa5980c4-4892-4158-a2cd-cda636f582e6 tempest-VolumesNegativeTest-42649051 None] Acquiring lock "cinder-quobyte-f5cb5abc-7190-4f14-b042-7a92685c1f4f" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:17:52 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-aa5980c4-4892-4158-a2cd-cda636f582e6 tempest-VolumesNegativeTest-42649051 None] Lock "cinder-quobyte-f5cb5abc-7190-4f14-b042-7a92685c1f4f" acquired by "delete_volume" :: waited 0.022s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:17:52 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da78183-a33c-44c3-919f-d1c3c2f0d020]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:17:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aa5980c4-4892-4158-a2cd-cda636f582e6 tempest-VolumesNegativeTest-42649051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f5cb5abc-7190-4f14-b042-7a92685c1f4f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:52 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f5cb5abc-7190-4f14-b042-7a92685c1f4f Jul 22 12:17:52 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:52 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5f7b2fe-060c-4dc4-8b2e-0026967b8e1d tempest-VolumesActionsTest-1474808239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391" returned: 0 in 0.688s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:52 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-d5f7b2fe-060c-4dc4-8b2e-0026967b8e1d tempest-VolumesActionsTest-1474808239 None] Image conversion details: src /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/conversion/9cd6cff4-d838-42b9-8dbf-7b765d87a391.temp_image.649fdce8-86e8-4897-8a36-2a22e51a8a50ba93hx77.img {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:17:52 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-d5f7b2fe-060c-4dc4-8b2e-0026967b8e1d tempest-VolumesActionsTest-1474808239 None] Converted 1024.00 MB image at 166.80 MB/s Jul 22 12:17:52 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-d5f7b2fe-060c-4dc4-8b2e-0026967b8e1d tempest-VolumesActionsTest-1474808239 None] 649fdce8-86e8-4897-8a36-2a22e51a8a50 was raw, no need to convert to raw {{(pid=87568) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 22 12:17:52 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aa5980c4-4892-4158-a2cd-cda636f582e6 tempest-VolumesNegativeTest-42649051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f5cb5abc-7190-4f14-b042-7a92685c1f4f" returned: 0 in 0.399s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aa5980c4-4892-4158-a2cd-cda636f582e6 tempest-VolumesNegativeTest-42649051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f5cb5abc-7190-4f14-b042-7a92685c1f4f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:52 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f5cb5abc-7190-4f14-b042-7a92685c1f4f Jul 22 12:17:52 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:53 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aa5980c4-4892-4158-a2cd-cda636f582e6 tempest-VolumesNegativeTest-42649051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f5cb5abc-7190-4f14-b042-7a92685c1f4f" returned: 0 in 0.266s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:53 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-aa5980c4-4892-4158-a2cd-cda636f582e6 tempest-VolumesNegativeTest-42649051 None] Lock "cinder-quobyte-f5cb5abc-7190-4f14-b042-7a92685c1f4f" released by "delete_volume" :: held 0.715s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:17:53 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-aa5980c4-4892-4158-a2cd-cda636f582e6 tempest-VolumesNegativeTest-42649051 None] Created reservations ['973cb915-c7a9-4b83-aacc-232cfdea428e', 'cfd4ac16-539c-4fff-bde8-39529617b595', '12f155ae-a493-4440-b303-080655aeed26', 'f8a345ba-87d4-4d11-a867-ccc88dc2a39f'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:17:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aa5980c4-4892-4158-a2cd-cda636f582e6 tempest-VolumesNegativeTest-42649051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:17:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aa5980c4-4892-4158-a2cd-cda636f582e6 tempest-VolumesNegativeTest-42649051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:17:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-aa5980c4-4892-4158-a2cd-cda636f582e6 tempest-VolumesNegativeTest-42649051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:17:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-aa5980c4-4892-4158-a2cd-cda636f582e6 tempest-VolumesNegativeTest-42649051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:17:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aa5980c4-4892-4158-a2cd-cda636f582e6 tempest-VolumesNegativeTest-42649051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:17:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aa5980c4-4892-4158-a2cd-cda636f582e6 tempest-VolumesNegativeTest-42649051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:17:53 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:17:53 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:17:53 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Jul 22 12:17:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aa5980c4-4892-4158-a2cd-cda636f582e6 tempest-VolumesNegativeTest-42649051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.277s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:17:53 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-aa5980c4-4892-4158-a2cd-cda636f582e6 tempest-VolumesNegativeTest-42649051 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:17:53 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-aa5980c4-4892-4158-a2cd-cda636f582e6 tempest-VolumesNegativeTest-42649051 None] Deleted volume successfully. Jul 22 12:17:53 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-aa5980c4-4892-4158-a2cd-cda636f582e6 tempest-VolumesNegativeTest-42649051 None] Lock "cinder-f5cb5abc-7190-4f14-b042-7a92685c1f4f-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:03 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:UPDATE=101,cinder:SELECT=94,cinder:DELETE=8,cinder:INSERT=23 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:18:03 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=77,cinder:INSERT=24,cinder:UPDATE=81,cinder:DELETE=5 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:18:10 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:18:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Flow 'volume_create_manager' (99ceb3c7-b17c-4f34-90ab-8dca1c1688e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:18:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370b5f6c-978e-4afb-bd75-76b2758fb14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370b5f6c-978e-4afb-bd75-76b2758fb14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1863173992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4910087a-4deb-42ad-a177-91a7599293a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d049f95ddde4ba09b45711208c08bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:18:10Z,use_quota=True,user_id='632f3d946ce143c2ad87ebd720469102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22433f09-c8f4-40f6-8898-512813d8b7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22433f09-c8f4-40f6-8898-512813d8b7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bffca8c-1bcc-42ff-9f13-9ccd6629dd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bffca8c-1bcc-42ff-9f13-9ccd6629dd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4910087a-4deb-42ad-a177-91a7599293a7', 'volume_name': 'volume-4910087a-4deb-42ad-a177-91a7599293a7', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f7017c4-8b87-4241-b822-c069222ce52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f7017c4-8b87-4241-b822-c069222ce52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b83282-11c0-474b-b4ce-1381e362ae56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:10 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Volume 4910087a-4deb-42ad-a177-91a7599293a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4910087a-4deb-42ad-a177-91a7599293a7', 'volume_size': 1} Jul 22 12:18:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d5f7b2fe-060c-4dc4-8b2e-0026967b8e1d tempest-VolumesActionsTest-1474808239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.147s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d5f7b2fe-060c-4dc4-8b2e-0026967b8e1d tempest-VolumesActionsTest-1474808239 None] Uploaded volume to glance image-id: 649fdce8-86e8-4897-8a36-2a22e51a8a50. {{(pid=87568) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 22 12:18:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.234s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-648580667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21835d20-e236-447c-b31e-cb1941de071e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c4aa921baf4991aaba1f0984260946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:17:51Z,use_quota=True,user_id='30a48a0ee1c540768971b344c3e84312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:18:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Creating volume 21835d20-e236-447c-b31e-cb1941de071e {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:18:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:18:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:18:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:18:17 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:18:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-21835d20-e236-447c-b31e-cb1941de071e 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:17 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-21835d20-e236-447c-b31e-cb1941de071e 1073741824 Jul 22 12:18:17 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:17 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d5f7b2fe-060c-4dc4-8b2e-0026967b8e1d tempest-VolumesActionsTest-1474808239 None] Copy volume to image completed successfully. Jul 22 12:18:17 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-21835d20-e236-447c-b31e-cb1941de071e 1073741824" returned: 0 in 0.547s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-21835d20-e236-447c-b31e-cb1941de071e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:17 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-21835d20-e236-447c-b31e-cb1941de071e Jul 22 12:18:17 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:17 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-21835d20-e236-447c-b31e-cb1941de071e" returned: 0 in 0.339s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:18:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.839s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1863173992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4910087a-4deb-42ad-a177-91a7599293a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d049f95ddde4ba09b45711208c08bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:18:10Z,use_quota=True,user_id='632f3d946ce143c2ad87ebd720469102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Creating volume 4910087a-4deb-42ad-a177-91a7599293a7 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:18:18 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1fe3c4-99ec-43a6-8e2b-a5c515f4b1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21835d20-e236-447c-b31e-cb1941de071e', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:18 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7 1073741824 Jul 22 12:18:18 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e33eb46-a217-4585-95d3-2c242eb521c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:18 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Volume volume-21835d20-e236-447c-b31e-cb1941de071e (21835d20-e236-447c-b31e-cb1941de071e): created successfully Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e33eb46-a217-4585-95d3-2c242eb521c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Flow 'volume_create_manager' (6cd7c028-e3dd-4c79-8ee2-d0540ebecc18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:18:18 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-5776e821-4105-410e-a54a-ea5d3a50170f tempest-VolumesActionsTest-2008170282 None] Created volume successfully. Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:18 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7 1073741824" returned: 0 in 0.509s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:18 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7 Jul 22 12:18:18 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:18 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7" returned: 0 in 0.271s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.395s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b83282-11c0-474b-b4ce-1381e362ae56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4910087a-4deb-42ad-a177-91a7599293a7', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dedf7b38-d4c7-4c1e-964a-d9a12c3c1253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[59402f96-9b3e-45bd-9c3e-ea7a2453478f]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:18 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Volume volume-4910087a-4deb-42ad-a177-91a7599293a7 (4910087a-4deb-42ad-a177-91a7599293a7): created successfully Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dedf7b38-d4c7-4c1e-964a-d9a12c3c1253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Flow 'volume_create_manager' (99ceb3c7-b17c-4f34-90ab-8dca1c1688e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:18:18 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-daad9a93-4e89-4cd5-9f02-69be8aa04822 tempest-VolumesSnapshotTestJSON-493288019 None] Created volume successfully. Jul 22 12:18:18 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5be65d6c-d45f-4425-a52b-692e819cdeb7 tempest-VolumesActionsTest-801594599 None] Acquiring lock "cinder-21835d20-e236-447c-b31e-cb1941de071e-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:18 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 Jul 22 12:18:18 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5be65d6c-d45f-4425-a52b-692e819cdeb7 tempest-VolumesActionsTest-801594599 None] Lock "cinder-21835d20-e236-447c-b31e-cb1941de071e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5be65d6c-d45f-4425-a52b-692e819cdeb7 tempest-VolumesActionsTest-801594599 None] Acquiring lock "cinder-quobyte-21835d20-e236-447c-b31e-cb1941de071e" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5be65d6c-d45f-4425-a52b-692e819cdeb7 tempest-VolumesActionsTest-801594599 None] Lock "cinder-quobyte-21835d20-e236-447c-b31e-cb1941de071e" acquired by "delete_volume" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:19 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6637e2b4-c168-4639-8704-c5466f21ee7e]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5be65d6c-d45f-4425-a52b-692e819cdeb7 tempest-VolumesActionsTest-801594599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-21835d20-e236-447c-b31e-cb1941de071e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:19 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-21835d20-e236-447c-b31e-cb1941de071e Jul 22 12:18:19 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:19 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391" returned: 0 in 0.437s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:19 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[452cde49-46dc-463a-bb2e-66c1a066f2a3]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:19 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 Jul 22 12:18:19 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:19 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5be65d6c-d45f-4425-a52b-692e819cdeb7 tempest-VolumesActionsTest-801594599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-21835d20-e236-447c-b31e-cb1941de071e" returned: 0 in 0.452s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5be65d6c-d45f-4425-a52b-692e819cdeb7 tempest-VolumesActionsTest-801594599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-21835d20-e236-447c-b31e-cb1941de071e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:19 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-21835d20-e236-447c-b31e-cb1941de071e Jul 22 12:18:19 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:19 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391" returned: 0 in 0.497s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 /opt/stack/data/cinder/conversion/9cd6cff4-d838-42b9-8dbf-7b765d87a391.temp_image.f6700f14-b627-4583-995f-e9b5e216e966s57wq7hj.img {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:19 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5be65d6c-d45f-4425-a52b-692e819cdeb7 tempest-VolumesActionsTest-801594599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-21835d20-e236-447c-b31e-cb1941de071e" returned: 0 in 0.321s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:19 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 /opt/stack/data/cinder/conversion/9cd6cff4-d838-42b9-8dbf-7b765d87a391.temp_image.f6700f14-b627-4583-995f-e9b5e216e966s57wq7hj.img Jul 22 12:18:19 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5be65d6c-d45f-4425-a52b-692e819cdeb7 tempest-VolumesActionsTest-801594599 None] Lock "cinder-quobyte-21835d20-e236-447c-b31e-cb1941de071e" released by "delete_volume" :: held 0.839s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:20 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-5be65d6c-d45f-4425-a52b-692e819cdeb7 tempest-VolumesActionsTest-801594599 None] Created reservations ['56faa2a0-f5ee-4712-b206-cf2240c48210', '987e6d58-7124-41c3-aa9d-d635515cab83', '3f685751-aefe-474b-b788-431bdde05be5', '396ab074-bb66-4303-adfd-1d816fc34878'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:18:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fe86a0c8-835d-478c-929d-c7a59fd97058 tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5be65d6c-d45f-4425-a52b-692e819cdeb7 tempest-VolumesActionsTest-801594599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5be65d6c-d45f-4425-a52b-692e819cdeb7 tempest-VolumesActionsTest-801594599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:20 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5be65d6c-d45f-4425-a52b-692e819cdeb7 tempest-VolumesActionsTest-801594599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:18:20 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5be65d6c-d45f-4425-a52b-692e819cdeb7 tempest-VolumesActionsTest-801594599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:18:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5be65d6c-d45f-4425-a52b-692e819cdeb7 tempest-VolumesActionsTest-801594599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5be65d6c-d45f-4425-a52b-692e819cdeb7 tempest-VolumesActionsTest-801594599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:20 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:18:20 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:20 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5be65d6c-d45f-4425-a52b-692e819cdeb7 tempest-VolumesActionsTest-801594599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.650s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:20 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-5be65d6c-d45f-4425-a52b-692e819cdeb7 tempest-VolumesActionsTest-801594599 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:18:20 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-5be65d6c-d45f-4425-a52b-692e819cdeb7 tempest-VolumesActionsTest-801594599 None] Deleted volume successfully. Jul 22 12:18:21 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5be65d6c-d45f-4425-a52b-692e819cdeb7 tempest-VolumesActionsTest-801594599 None] Lock "cinder-21835d20-e236-447c-b31e-cb1941de071e-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:22 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:18:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Flow 'volume_create_manager' (ec46a257-5d21-4ce1-b2bb-f5b72a013594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:18:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315899ec-7212-4325-bc13-4e1d77dc7cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:22 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:18:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Flow 'volume_create_manager' (5dc1beb0-1ecd-4b7e-b91a-c3e9fd8ac74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:18:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abcd6d87-b0a8-480a-af30-ea700839bb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315899ec-7212-4325-bc13-4e1d77dc7cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-731753783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b262626-0dbe-4fb5-853e-06bac1abac7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf16ab83ae794db2aa726864c8f97038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:18:22Z,use_quota=True,user_id='47500dce458c4a7e96ef653899625b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0558a1-b24a-460b-8938-b297d0a4d1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0558a1-b24a-460b-8938-b297d0a4d1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253f3492-f260-42d6-be9a-a1f7d7b15249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:22 devstack cinder-volume[87568]: DEBUG cinder.image.glance [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Creating Keystone auth plugin from conf {{(pid=87568) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 12:18:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abcd6d87-b0a8-480a-af30-ea700839bb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-24856195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0009a4cb-848d-4792-b1ab-335378cc17ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c4aa921baf4991aaba1f0984260946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:18:22Z,use_quota=True,user_id='30a48a0ee1c540768971b344c3e84312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72052025-db82-4eda-b88c-26b180ee2183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72052025-db82-4eda-b88c-26b180ee2183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c617f06-f744-4918-b80e-c3070b771b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c617f06-f744-4918-b80e-c3070b771b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0009a4cb-848d-4792-b1ab-335378cc17ba', 'volume_name': 'volume-0009a4cb-848d-4792-b1ab-335378cc17ba', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a6958d-0956-4c44-8d48-b4546a6df5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a6958d-0956-4c44-8d48-b4546a6df5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf8b010-bf7e-4ac9-9b21-ec31541f66d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:23 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Volume 0009a4cb-848d-4792-b1ab-335378cc17ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0009a4cb-848d-4792-b1ab-335378cc17ba', 'volume_size': 1} Jul 22 12:18:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253f3492-f260-42d6-be9a-a1f7d7b15249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1b262626-0dbe-4fb5-853e-06bac1abac7e', 'volume_name': 'volume-1b262626-0dbe-4fb5-853e-06bac1abac7e', 'volume_size': 1, 'image_id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fe02ba8749e04b7eaeb23823f684fdc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'created_at': datetime.datetime(2026, 7, 22, 10, 2, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 2, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c78e7f-c7ae-4d39-95c2-1124c0b4c1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c78e7f-c7ae-4d39-95c2-1124c0b4c1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ecbb3e-d25d-4997-a2e2-cd2ebe8984fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:23 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Volume 1b262626-0dbe-4fb5-853e-06bac1abac7e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1b262626-0dbe-4fb5-853e-06bac1abac7e', 'volume_size': 1, 'image_id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fe02ba8749e04b7eaeb23823f684fdc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'created_at': datetime.datetime(2026, 7, 22, 10, 2, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 2, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 22 12:18:23 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Trying to clone 1b262626-0dbe-4fb5-853e-06bac1abac7e from image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e at location (None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}]). {{(pid=87568) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 12:18:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:18:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:18:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:18:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:24 devstack sudo[97823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:18:24 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:24 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_3hcd89bsdevstack@QuobyteHD, size 20.69 MB, duration 1.11 sec {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 12:18:25 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Image download 20.69 MB at 18.59 MB/s Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 /opt/stack/data/cinder/conversion/9cd6cff4-d838-42b9-8dbf-7b765d87a391.temp_image.f6700f14-b627-4583-995f-e9b5e216e966s57wq7hj.img" returned: 0 in 5.199s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc127ab1-a839-41f3-8621-574b0fa426b2]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a0512f-14a9-42bb-95a2-9b823d63b290]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_3hcd89bsdevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:25 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.653s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread count: 28 {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread info: [<_MainThread(MainThread, started 137793405739136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:18:25 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 Jul 22 12:18:25 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:25 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_3hcd89bsdevstack@QuobyteHD Jul 22 12:18:25 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:25 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_3hcd89bsdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Temporary image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e is fetched for user 47500dce458c4a7e96ef653899625b2f. {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[7567c01a-6b2f-49bc-a4a8-e3ff2e1bdaac]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_3hcd89bsdevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:25 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391" returned: 0 in 0.539s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] Image conversion details: src /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391, size 1024.00 MB, duration 5.20 sec, destination /opt/stack/data/cinder/conversion/9cd6cff4-d838-42b9-8dbf-7b765d87a391.temp_image.f6700f14-b627-4583-995f-e9b5e216e966s57wq7hj.img {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:18:25 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] Converted 1024.00 MB image at 196.93 MB/s Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] f6700f14-b627-4583-995f-e9b5e216e966 was raw, converting to qcow2 {{(pid=87568) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 22 12:18:25 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_3hcd89bsdevstack@QuobyteHD Jul 22 12:18:25 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e23b2d-1197-40d9-a565-85a07a67f427]: (4, 'raw') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9cd6cff4-d838-42b9-8dbf-7b765d87a391.temp_image.f6700f14-b627-4583-995f-e9b5e216e966s57wq7hj.img {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:25 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9cd6cff4-d838-42b9-8dbf-7b765d87a391.temp_image.f6700f14-b627-4583-995f-e9b5e216e966s57wq7hj.img Jul 22 12:18:25 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:25 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_3hcd89bsdevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:25 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9cd6cff4-d838-42b9-8dbf-7b765d87a391.temp_image.f6700f14-b627-4583-995f-e9b5e216e966s57wq7hj.img" returned: 0 in 0.331s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9cd6cff4-d838-42b9-8dbf-7b765d87a391.temp_image.f6700f14-b627-4583-995f-e9b5e216e966s57wq7hj.img {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:26 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9cd6cff4-d838-42b9-8dbf-7b765d87a391.temp_image.f6700f14-b627-4583-995f-e9b5e216e966s57wq7hj.img Jul 22 12:18:26 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:26 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9cd6cff4-d838-42b9-8dbf-7b765d87a391.temp_image.f6700f14-b627-4583-995f-e9b5e216e966s57wq7hj.img" returned: 1 in 0.314s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9cd6cff4-d838-42b9-8dbf-7b765d87a391.temp_image.f6700f14-b627-4583-995f-e9b5e216e966s57wq7hj.img' failed. Not Retrying. {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:18:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9cd6cff4-d838-42b9-8dbf-7b765d87a391.temp_image.f6700f14-b627-4583-995f-e9b5e216e966s57wq7hj.img /opt/stack/data/cinder/conversion/vol_upload_cvg827f_ {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:26 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9cd6cff4-d838-42b9-8dbf-7b765d87a391.temp_image.f6700f14-b627-4583-995f-e9b5e216e966s57wq7hj.img /opt/stack/data/cinder/conversion/vol_upload_cvg827f_ Jul 22 12:18:26 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:26 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9cd6cff4-d838-42b9-8dbf-7b765d87a391.temp_image.f6700f14-b627-4583-995f-e9b5e216e966s57wq7hj.img /opt/stack/data/cinder/conversion/vol_upload_cvg827f_" returned: 0 in 0.247s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:26 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] Image conversion details: src /opt/stack/data/cinder/conversion/9cd6cff4-d838-42b9-8dbf-7b765d87a391.temp_image.f6700f14-b627-4583-995f-e9b5e216e966s57wq7hj.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_cvg827f_ {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:18:26 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 22 12:18:26 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbcd8a0-0233-42f5-8290-6ad48c18dcc1]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cvg827f_ {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:26 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cvg827f_ Jul 22 12:18:26 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:26 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cvg827f_" returned: 0 in 0.315s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.274s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:28 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] Uploaded volume to glance image-id: f6700f14-b627-4583-995f-e9b5e216e966. {{(pid=87568) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 22 12:18:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fe86a0c8-835d-478c-929d-c7a59fd97058 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.029s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-fe86a0c8-835d-478c-929d-c7a59fd97058 tempest-VolumesSnapshotTestJSON-493288019 None] Creating offline snapshot 2494832f-cf3e-4ac6-8570-071ef10f37c2 of volume 4910087a-4deb-42ad-a177-91a7599293a7 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:18:28 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-10025e0b-409c-4c11-9530-f52d798742ea tempest-VolumesActionsTest-1474808239 None] Copy volume to image completed successfully. Jul 22 12:18:28 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[200d1a4d-68cd-4c62-931e-5b390f724949]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fe86a0c8-835d-478c-929d-c7a59fd97058 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:28 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7 Jul 22 12:18:28 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:28 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fe86a0c8-835d-478c-929d-c7a59fd97058 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7" returned: 0 in 0.348s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fe86a0c8-835d-478c-929d-c7a59fd97058 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.2494832f-cf3e-4ac6-8570-071ef10f37c2 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:28 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.2494832f-cf3e-4ac6-8570-071ef10f37c2 1G Jul 22 12:18:28 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:28 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fe86a0c8-835d-478c-929d-c7a59fd97058 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.2494832f-cf3e-4ac6-8570-071ef10f37c2 1G" returned: 0 in 0.379s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fe86a0c8-835d-478c-929d-c7a59fd97058 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4910087a-4deb-42ad-a177-91a7599293a7 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.2494832f-cf3e-4ac6-8570-071ef10f37c2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:28 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4910087a-4deb-42ad-a177-91a7599293a7 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.2494832f-cf3e-4ac6-8570-071ef10f37c2 Jul 22 12:18:28 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:29 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fe86a0c8-835d-478c-929d-c7a59fd97058 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4910087a-4deb-42ad-a177-91a7599293a7 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.2494832f-cf3e-4ac6-8570-071ef10f37c2" returned: 0 in 0.296s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:29 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-fe86a0c8-835d-478c-929d-c7a59fd97058 tempest-VolumesSnapshotTestJSON-493288019 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.2494832f-cf3e-4ac6-8570-071ef10f37c2 is being set with open permissions: ugo+rw Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fe86a0c8-835d-478c-929d-c7a59fd97058 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.2494832f-cf3e-4ac6-8570-071ef10f37c2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:29 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.2494832f-cf3e-4ac6-8570-071ef10f37c2 Jul 22 12:18:29 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:29 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fe86a0c8-835d-478c-929d-c7a59fd97058 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.2494832f-cf3e-4ac6-8570-071ef10f37c2" returned: 0 in 0.242s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fe86a0c8-835d-478c-929d-c7a59fd97058 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:29 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.info Jul 22 12:18:29 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:29 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fe86a0c8-835d-478c-929d-c7a59fd97058 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.info" returned: 0 in 0.249s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:29 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-fe86a0c8-835d-478c-929d-c7a59fd97058 tempest-VolumesSnapshotTestJSON-493288019 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.info is being set with open permissions: ugo+rw Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fe86a0c8-835d-478c-929d-c7a59fd97058 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:29 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.info Jul 22 12:18:29 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3c5264b9-2b96-41ed-ae34-d957f32bec74 tempest-VolumesActionsTest-1474808239 None] Acquiring lock "cinder-9cd6cff4-d838-42b9-8dbf-7b765d87a391-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3c5264b9-2b96-41ed-ae34-d957f32bec74 tempest-VolumesActionsTest-1474808239 None] Lock "cinder-9cd6cff4-d838-42b9-8dbf-7b765d87a391-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3c5264b9-2b96-41ed-ae34-d957f32bec74 tempest-VolumesActionsTest-1474808239 None] Acquiring lock "cinder-quobyte-9cd6cff4-d838-42b9-8dbf-7b765d87a391" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3c5264b9-2b96-41ed-ae34-d957f32bec74 tempest-VolumesActionsTest-1474808239 None] Lock "cinder-quobyte-9cd6cff4-d838-42b9-8dbf-7b765d87a391" acquired by "delete_volume" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d84809f-0453-45c5-b4c7-f68539ae748b]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3c5264b9-2b96-41ed-ae34-d957f32bec74 tempest-VolumesActionsTest-1474808239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:29 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fe86a0c8-835d-478c-929d-c7a59fd97058 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.info" returned: 0 in 0.253s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fe86a0c8-835d-478c-929d-c7a59fd97058 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.855s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.864s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-24856195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0009a4cb-848d-4792-b1ab-335378cc17ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c4aa921baf4991aaba1f0984260946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:18:22Z,use_quota=True,user_id='30a48a0ee1c540768971b344c3e84312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Creating volume 0009a4cb-848d-4792-b1ab-335378cc17ba {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:18:29 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 Jul 22 12:18:29 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:18:29 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:18:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0009a4cb-848d-4792-b1ab-335378cc17ba 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:30 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0009a4cb-848d-4792-b1ab-335378cc17ba 1073741824 Jul 22 12:18:30 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:30 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-fe86a0c8-835d-478c-929d-c7a59fd97058 tempest-VolumesSnapshotTestJSON-493288019 None] Create snapshot completed successfully Jul 22 12:18:30 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3c5264b9-2b96-41ed-ae34-d957f32bec74 tempest-VolumesActionsTest-1474808239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391" returned: 0 in 0.366s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3c5264b9-2b96-41ed-ae34-d957f32bec74 tempest-VolumesActionsTest-1474808239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:30 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391 Jul 22 12:18:30 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:30 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0009a4cb-848d-4792-b1ab-335378cc17ba 1073741824" returned: 0 in 0.494s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:30 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3c5264b9-2b96-41ed-ae34-d957f32bec74 tempest-VolumesActionsTest-1474808239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9cd6cff4-d838-42b9-8dbf-7b765d87a391" returned: 0 in 0.264s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3c5264b9-2b96-41ed-ae34-d957f32bec74 tempest-VolumesActionsTest-1474808239 None] Lock "cinder-quobyte-9cd6cff4-d838-42b9-8dbf-7b765d87a391" released by "delete_volume" :: held 0.679s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0009a4cb-848d-4792-b1ab-335378cc17ba {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:30 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0009a4cb-848d-4792-b1ab-335378cc17ba Jul 22 12:18:30 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-3c5264b9-2b96-41ed-ae34-d957f32bec74 tempest-VolumesActionsTest-1474808239 None] Created reservations ['aadb25cc-f8df-4553-9d78-51698c1c0953', '92635abe-482f-46b9-9355-ac6edadb77cd', 'e753d2c0-8d36-43a9-92f4-f57936ad0a6f', 'd1c9d206-2ea1-4962-8e4c-12baa7b044a1'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3c5264b9-2b96-41ed-ae34-d957f32bec74 tempest-VolumesActionsTest-1474808239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3c5264b9-2b96-41ed-ae34-d957f32bec74 tempest-VolumesActionsTest-1474808239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3c5264b9-2b96-41ed-ae34-d957f32bec74 tempest-VolumesActionsTest-1474808239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3c5264b9-2b96-41ed-ae34-d957f32bec74 tempest-VolumesActionsTest-1474808239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3c5264b9-2b96-41ed-ae34-d957f32bec74 tempest-VolumesActionsTest-1474808239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3c5264b9-2b96-41ed-ae34-d957f32bec74 tempest-VolumesActionsTest-1474808239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:30 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:18:30 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:30 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0009a4cb-848d-4792-b1ab-335378cc17ba" returned: 0 in 0.263s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.022s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-731753783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b262626-0dbe-4fb5-853e-06bac1abac7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf16ab83ae794db2aa726864c8f97038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:18:22Z,use_quota=True,user_id='47500dce458c4a7e96ef653899625b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Creating volume 1b262626-0dbe-4fb5-853e-06bac1abac7e {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:18:30 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1b262626-0dbe-4fb5-853e-06bac1abac7e 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf8b010-bf7e-4ac9-9b21-ec31541f66d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0009a4cb-848d-4792-b1ab-335378cc17ba', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a4a51c0-4be5-49a3-825c-3cb0ba450806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:30 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1b262626-0dbe-4fb5-853e-06bac1abac7e 1073741824 Jul 22 12:18:30 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:30 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Volume volume-0009a4cb-848d-4792-b1ab-335378cc17ba (0009a4cb-848d-4792-b1ab-335378cc17ba): created successfully Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a4a51c0-4be5-49a3-825c-3cb0ba450806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Flow 'volume_create_manager' (5dc1beb0-1ecd-4b7e-b91a-c3e9fd8ac74e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:18:30 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-5e8f38fc-2adf-409a-b45b-bddce051838f tempest-VolumesActionsTest-2008170282 None] Created volume successfully. Jul 22 12:18:30 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3c5264b9-2b96-41ed-ae34-d957f32bec74 tempest-VolumesActionsTest-1474808239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.272s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-3c5264b9-2b96-41ed-ae34-d957f32bec74 tempest-VolumesActionsTest-1474808239 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:18:30 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-3c5264b9-2b96-41ed-ae34-d957f32bec74 tempest-VolumesActionsTest-1474808239 None] Deleted volume successfully. Jul 22 12:18:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3c5264b9-2b96-41ed-ae34-d957f32bec74 tempest-VolumesActionsTest-1474808239 None] Lock "cinder-9cd6cff4-d838-42b9-8dbf-7b765d87a391-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-87b5d50f-d6ca-4aa4-b2ac-9393720c7ba0 tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-2494832f-cf3e-4ac6-8570-071ef10f37c2-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-87b5d50f-d6ca-4aa4-b2ac-9393720c7ba0 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-2494832f-cf3e-4ac6-8570-071ef10f37c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-87b5d50f-d6ca-4aa4-b2ac-9393720c7ba0 tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-quobyte-4910087a-4deb-42ad-a177-91a7599293a7" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-87b5d50f-d6ca-4aa4-b2ac-9393720c7ba0 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-4910087a-4deb-42ad-a177-91a7599293a7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-87b5d50f-d6ca-4aa4-b2ac-9393720c7ba0 tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-quobyte-2494832f-cf3e-4ac6-8570-071ef10f37c2" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-87b5d50f-d6ca-4aa4-b2ac-9393720c7ba0 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-2494832f-cf3e-4ac6-8570-071ef10f37c2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-87b5d50f-d6ca-4aa4-b2ac-9393720c7ba0 tempest-VolumesSnapshotTestJSON-493288019 None] Deleting offline snapshot 2494832f-cf3e-4ac6-8570-071ef10f37c2 of volume 4910087a-4deb-42ad-a177-91a7599293a7 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:18:31 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-87b5d50f-d6ca-4aa4-b2ac-9393720c7ba0 tempest-VolumesSnapshotTestJSON-493288019 None] snapshot_file for this snap is: volume-4910087a-4deb-42ad-a177-91a7599293a7.2494832f-cf3e-4ac6-8570-071ef10f37c2 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1b262626-0dbe-4fb5-853e-06bac1abac7e 1073741824" returned: 0 in 0.607s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[75382e58-9a91-41f3-af36-ab18dc5de348]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-87b5d50f-d6ca-4aa4-b2ac-9393720c7ba0 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.2494832f-cf3e-4ac6-8570-071ef10f37c2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1b262626-0dbe-4fb5-853e-06bac1abac7e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:31 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1b262626-0dbe-4fb5-853e-06bac1abac7e Jul 22 12:18:31 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:31 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.2494832f-cf3e-4ac6-8570-071ef10f37c2 Jul 22 12:18:31 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5e2a4688-a518-4126-b599-e901a8a90053 tempest-VolumesActionsTest-801594599 None] Acquiring lock "cinder-0009a4cb-848d-4792-b1ab-335378cc17ba-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5e2a4688-a518-4126-b599-e901a8a90053 tempest-VolumesActionsTest-801594599 None] Lock "cinder-0009a4cb-848d-4792-b1ab-335378cc17ba-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:31 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1b262626-0dbe-4fb5-853e-06bac1abac7e" returned: 0 in 0.328s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5e2a4688-a518-4126-b599-e901a8a90053 tempest-VolumesActionsTest-801594599 None] Acquiring lock "cinder-quobyte-0009a4cb-848d-4792-b1ab-335378cc17ba" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5e2a4688-a518-4126-b599-e901a8a90053 tempest-VolumesActionsTest-801594599 None] Lock "cinder-quobyte-0009a4cb-848d-4792-b1ab-335378cc17ba" acquired by "delete_volume" :: waited 0.031s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Attempting download of 97d73ec3-9d73-4df3-baa6-cc90fa33d35e ((None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}])) to volume 1b262626-0dbe-4fb5-853e-06bac1abac7e. {{(pid=87568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfa1072-994c-497b-98d0-dd7f97bff7f7]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5e2a4688-a518-4126-b599-e901a8a90053 tempest-VolumesActionsTest-801594599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0009a4cb-848d-4792-b1ab-335378cc17ba {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d4362c-2a36-445d-94b3-17421e6cc0fa]: (4, 'raw') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_chcknshi {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:32 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-87b5d50f-d6ca-4aa4-b2ac-9393720c7ba0 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.2494832f-cf3e-4ac6-8570-071ef10f37c2" returned: 0 in 0.545s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-87b5d50f-d6ca-4aa4-b2ac-9393720c7ba0 tempest-VolumesSnapshotTestJSON-493288019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4910087a-4deb-42ad-a177-91a7599293a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:18:32 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0009a4cb-848d-4792-b1ab-335378cc17ba Jul 22 12:18:32 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7ee241-fd4a-49bd-b7c8-216a8c763809]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-87b5d50f-d6ca-4aa4-b2ac-9393720c7ba0 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:32 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_chcknshi Jul 22 12:18:32 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:32 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7 Jul 22 12:18:32 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:32 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:32 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_chcknshi" returned: 0 in 0.364s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_chcknshi {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5e2a4688-a518-4126-b599-e901a8a90053 tempest-VolumesActionsTest-801594599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0009a4cb-848d-4792-b1ab-335378cc17ba" returned: 0 in 0.429s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5e2a4688-a518-4126-b599-e901a8a90053 tempest-VolumesActionsTest-801594599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0009a4cb-848d-4792-b1ab-335378cc17ba {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:32 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0009a4cb-848d-4792-b1ab-335378cc17ba Jul 22 12:18:32 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:32 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_chcknshi Jul 22 12:18:32 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-87b5d50f-d6ca-4aa4-b2ac-9393720c7ba0 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7" returned: 0 in 0.444s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-87b5d50f-d6ca-4aa4-b2ac-9393720c7ba0 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.2494832f-cf3e-4ac6-8570-071ef10f37c2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:32 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:32 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.2494832f-cf3e-4ac6-8570-071ef10f37c2 Jul 22 12:18:32 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:32 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5e2a4688-a518-4126-b599-e901a8a90053 tempest-VolumesActionsTest-801594599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-0009a4cb-848d-4792-b1ab-335378cc17ba" returned: 0 in 0.344s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5e2a4688-a518-4126-b599-e901a8a90053 tempest-VolumesActionsTest-801594599 None] Lock "cinder-quobyte-0009a4cb-848d-4792-b1ab-335378cc17ba" released by "delete_volume" :: held 0.827s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:32 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_chcknshi" returned: 1 in 0.398s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_chcknshi' failed. Not Retrying. {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb44389-e94d-44fd-9434-4e683b99da5f]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_3hcd89bsdevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-5e2a4688-a518-4126-b599-e901a8a90053 tempest-VolumesActionsTest-801594599 None] Created reservations ['511b7f3c-fa04-4995-b708-ed8af23f5a77', '8f035eae-4fb2-4881-91e1-c4cdbed957d3', '5c2999aa-e657-4229-8fcc-c674ab95307d', '04733045-4e32-4d9a-8d3d-1e7d13a28160'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5e2a4688-a518-4126-b599-e901a8a90053 tempest-VolumesActionsTest-801594599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5e2a4688-a518-4126-b599-e901a8a90053 tempest-VolumesActionsTest-801594599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5e2a4688-a518-4126-b599-e901a8a90053 tempest-VolumesActionsTest-801594599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5e2a4688-a518-4126-b599-e901a8a90053 tempest-VolumesActionsTest-801594599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5e2a4688-a518-4126-b599-e901a8a90053 tempest-VolumesActionsTest-801594599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5e2a4688-a518-4126-b599-e901a8a90053 tempest-VolumesActionsTest-801594599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:32 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_3hcd89bsdevstack@QuobyteHD Jul 22 12:18:32 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:32 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:18:32 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:32 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-87b5d50f-d6ca-4aa4-b2ac-9393720c7ba0 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.2494832f-cf3e-4ac6-8570-071ef10f37c2" returned: 0 in 0.449s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-87b5d50f-d6ca-4aa4-b2ac-9393720c7ba0 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.2494832f-cf3e-4ac6-8570-071ef10f37c2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:32 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.2494832f-cf3e-4ac6-8570-071ef10f37c2 Jul 22 12:18:32 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:33 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5e2a4688-a518-4126-b599-e901a8a90053 tempest-VolumesActionsTest-801594599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.332s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-5e2a4688-a518-4126-b599-e901a8a90053 tempest-VolumesActionsTest-801594599 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:18:33 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-5e2a4688-a518-4126-b599-e901a8a90053 tempest-VolumesActionsTest-801594599 None] Deleted volume successfully. Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5e2a4688-a518-4126-b599-e901a8a90053 tempest-VolumesActionsTest-801594599 None] Lock "cinder-0009a4cb-848d-4792-b1ab-335378cc17ba-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:33 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_3hcd89bsdevstack@QuobyteHD" returned: 0 in 0.570s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] 97d73ec3-9d73-4df3-baa6-cc90fa33d35e was qcow2, converting to qcow2 {{(pid=87568) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 12:18:33 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_3hcd89bsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1b262626-0dbe-4fb5-853e-06bac1abac7e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-87b5d50f-d6ca-4aa4-b2ac-9393720c7ba0 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7.2494832f-cf3e-4ac6-8570-071ef10f37c2" returned: 0 in 0.361s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:33 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_3hcd89bsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1b262626-0dbe-4fb5-853e-06bac1abac7e Jul 22 12:18:33 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-87b5d50f-d6ca-4aa4-b2ac-9393720c7ba0 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-2494832f-cf3e-4ac6-8570-071ef10f37c2" released by "_delete_snapshot" :: held 1.993s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-87b5d50f-d6ca-4aa4-b2ac-9393720c7ba0 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-4910087a-4deb-42ad-a177-91a7599293a7" released by "delete_snapshot" :: held 2.029s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-87b5d50f-d6ca-4aa4-b2ac-9393720c7ba0 tempest-VolumesSnapshotTestJSON-493288019 None] Created reservations ['f8e06a4b-6c31-40da-a5bb-fdebe0d1aff5', 'fd190e42-10fd-400f-9772-85de2b730f3b', '7ac49a5a-f96b-48d1-bc0b-1fde64720ac6', '9eac20a0-4894-40ff-a2ba-0bc9076adf61'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:18:33 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-87b5d50f-d6ca-4aa4-b2ac-9393720c7ba0 tempest-VolumesSnapshotTestJSON-493288019 None] Delete snapshot completed successfully. Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-87b5d50f-d6ca-4aa4-b2ac-9393720c7ba0 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-2494832f-cf3e-4ac6-8570-071ef10f37c2-delete_snapshot" released by "delete_snapshot" :: held 2.237s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Flow 'volume_create_manager' (c152a19c-9b6a-4ea9-95b6-6582a33e242e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a457ae6b-f496-4c86-b265-4b4338fee39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a457ae6b-f496-4c86-b265-4b4338fee39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1973293602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee65cbe-6cea-4034-b3a0-7d121eb20c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c4aa921baf4991aaba1f0984260946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:18:34Z,use_quota=True,user_id='30a48a0ee1c540768971b344c3e84312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a3be1a-70d4-4e8c-b8f1-a5384d22cd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a3be1a-70d4-4e8c-b8f1-a5384d22cd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93674866-a285-4115-a58a-12f97e5b49d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93674866-a285-4115-a58a-12f97e5b49d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ee65cbe-6cea-4034-b3a0-7d121eb20c89', 'volume_name': 'volume-5ee65cbe-6cea-4034-b3a0-7d121eb20c89', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464236db-05ed-4aed-951d-5a54a243e14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464236db-05ed-4aed-951d-5a54a243e14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78149a5c-0fd2-454e-90e7-fc3e8ac67f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:33 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Volume 5ee65cbe-6cea-4034-b3a0-7d121eb20c89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ee65cbe-6cea-4034-b3a0-7d121eb20c89', 'volume_size': 1} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1973293602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee65cbe-6cea-4034-b3a0-7d121eb20c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c4aa921baf4991aaba1f0984260946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:18:34Z,use_quota=True,user_id='30a48a0ee1c540768971b344c3e84312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Creating volume 5ee65cbe-6cea-4034-b3a0-7d121eb20c89 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:18:33 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:18:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5ee65cbe-6cea-4034-b3a0-7d121eb20c89 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:33 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5ee65cbe-6cea-4034-b3a0-7d121eb20c89 1073741824 Jul 22 12:18:33 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:34 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5ee65cbe-6cea-4034-b3a0-7d121eb20c89 1073741824" returned: 0 in 0.631s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5ee65cbe-6cea-4034-b3a0-7d121eb20c89 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:34 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5ee65cbe-6cea-4034-b3a0-7d121eb20c89 Jul 22 12:18:34 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:34 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5ee65cbe-6cea-4034-b3a0-7d121eb20c89" returned: 0 in 0.326s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:18:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78149a5c-0fd2-454e-90e7-fc3e8ac67f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ee65cbe-6cea-4034-b3a0-7d121eb20c89', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f5e56d-02a5-433b-a3f5-d6f360b3b78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:34 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Volume volume-5ee65cbe-6cea-4034-b3a0-7d121eb20c89 (5ee65cbe-6cea-4034-b3a0-7d121eb20c89): created successfully Jul 22 12:18:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f5e56d-02a5-433b-a3f5-d6f360b3b78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Flow 'volume_create_manager' (c152a19c-9b6a-4ea9-95b6-6582a33e242e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:18:34 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e9b1793a-2d28-415e-a39b-e6ac66afc120 tempest-VolumesActionsTest-2008170282 None] Created volume successfully. Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Flow 'volume_create_manager' (2bbe3e6f-719c-4d99-9c96-9df8b2a443f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1079d9a4-6a62-4dc7-a64c-9adf2efd2979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1079d9a4-6a62-4dc7-a64c-9adf2efd2979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-598869186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb571be-aedf-41ac-beb0-065e3861717c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d049f95ddde4ba09b45711208c08bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:18:35Z,use_quota=True,user_id='632f3d946ce143c2ad87ebd720469102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c787e86-e4e8-4873-9d48-f382580a17c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c787e86-e4e8-4873-9d48-f382580a17c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0839e76-5006-4cda-9641-73201174df68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0839e76-5006-4cda-9641-73201174df68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfb571be-aedf-41ac-beb0-065e3861717c', 'volume_name': 'volume-cfb571be-aedf-41ac-beb0-065e3861717c', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8545e4-2961-41a0-8f16-0e5f4d25b23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8545e4-2961-41a0-8f16-0e5f4d25b23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d35b63c-2cfa-4876-808a-1a6e322214d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:35 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Volume cfb571be-aedf-41ac-beb0-065e3861717c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfb571be-aedf-41ac-beb0-065e3861717c', 'volume_size': 1} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-598869186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb571be-aedf-41ac-beb0-065e3861717c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d049f95ddde4ba09b45711208c08bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:18:35Z,use_quota=True,user_id='632f3d946ce143c2ad87ebd720469102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Creating volume cfb571be-aedf-41ac-beb0-065e3861717c {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:18:35 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:35 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c 1073741824 Jul 22 12:18:35 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:35 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_3hcd89bsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1b262626-0dbe-4fb5-853e-06bac1abac7e" returned: 0 in 2.323s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_3hcd89bsdevstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1b262626-0dbe-4fb5-853e-06bac1abac7e {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:18:35 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Converted 112.00 MB image at 48.17 MB/s Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1b262626-0dbe-4fb5-853e-06bac1abac7e 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:35 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1b262626-0dbe-4fb5-853e-06bac1abac7e 1G Jul 22 12:18:35 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5cef980e-e137-4514-81ca-711dde947d06 tempest-VolumesActionsTest-801594599 None] Acquiring lock "cinder-5ee65cbe-6cea-4034-b3a0-7d121eb20c89-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5cef980e-e137-4514-81ca-711dde947d06 tempest-VolumesActionsTest-801594599 None] Lock "cinder-5ee65cbe-6cea-4034-b3a0-7d121eb20c89-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5cef980e-e137-4514-81ca-711dde947d06 tempest-VolumesActionsTest-801594599 None] Acquiring lock "cinder-quobyte-5ee65cbe-6cea-4034-b3a0-7d121eb20c89" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5cef980e-e137-4514-81ca-711dde947d06 tempest-VolumesActionsTest-801594599 None] Lock "cinder-quobyte-5ee65cbe-6cea-4034-b3a0-7d121eb20c89" acquired by "delete_volume" :: waited 0.022s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd1ff6b-7e0d-41da-9c25-475d8a37d341]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5cef980e-e137-4514-81ca-711dde947d06 tempest-VolumesActionsTest-801594599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5ee65cbe-6cea-4034-b3a0-7d121eb20c89 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:36 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c 1073741824" returned: 0 in 0.622s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:36 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1b262626-0dbe-4fb5-853e-06bac1abac7e 1G" returned: 0 in 0.513s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Downloaded image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e ((None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}])) to volume 1b262626-0dbe-4fb5-853e-06bac1abac7e successfully. {{(pid=87568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Temporary image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e for user 47500dce458c4a7e96ef653899625b2f is deleted. {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Marking volume 1b262626-0dbe-4fb5-853e-06bac1abac7e as bootable. {{(pid=87568) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 12:18:36 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c Jul 22 12:18:36 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Copying metadata from image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e to 1b262626-0dbe-4fb5-853e-06bac1abac7e. {{(pid=87568) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Creating volume glance metadata for volume 1b262626-0dbe-4fb5-853e-06bac1abac7e backed by image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87568) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 12:18:36 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5ee65cbe-6cea-4034-b3a0-7d121eb20c89 Jul 22 12:18:36 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ecbb3e-d25d-4997-a2e2-cd2ebe8984fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b262626-0dbe-4fb5-853e-06bac1abac7e', 'volume_size': 1, 'image_id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fe02ba8749e04b7eaeb23823f684fdc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'created_at': datetime.datetime(2026, 7, 22, 10, 2, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 2, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d53c0ac-79e4-468c-8ae6-7e4acf23371e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:36 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Volume volume-1b262626-0dbe-4fb5-853e-06bac1abac7e (1b262626-0dbe-4fb5-853e-06bac1abac7e): created successfully Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d53c0ac-79e4-468c-8ae6-7e4acf23371e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Flow 'volume_create_manager' (ec46a257-5d21-4ce1-b2bb-f5b72a013594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:18:36 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-8bed5e14-1d70-4b53-9501-130482d8734e tempest-TestShelveInstance-1552906758 None] Created volume successfully. Jul 22 12:18:36 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c" returned: 0 in 0.340s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d35b63c-2cfa-4876-808a-1a6e322214d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb571be-aedf-41ac-beb0-065e3861717c', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df57f4fa-086c-4af4-bca9-42b5429678ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:36 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Volume volume-cfb571be-aedf-41ac-beb0-065e3861717c (cfb571be-aedf-41ac-beb0-065e3861717c): created successfully Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df57f4fa-086c-4af4-bca9-42b5429678ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Flow 'volume_create_manager' (2bbe3e6f-719c-4d99-9c96-9df8b2a443f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:18:36 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-ee601f37-705a-407d-89d9-227f7f86dd7e tempest-VolumesSnapshotTestJSON-493288019 None] Created volume successfully. Jul 22 12:18:36 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5cef980e-e137-4514-81ca-711dde947d06 tempest-VolumesActionsTest-801594599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5ee65cbe-6cea-4034-b3a0-7d121eb20c89" returned: 0 in 0.499s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5cef980e-e137-4514-81ca-711dde947d06 tempest-VolumesActionsTest-801594599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5ee65cbe-6cea-4034-b3a0-7d121eb20c89 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:36 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5ee65cbe-6cea-4034-b3a0-7d121eb20c89 Jul 22 12:18:36 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:36 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5cef980e-e137-4514-81ca-711dde947d06 tempest-VolumesActionsTest-801594599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5ee65cbe-6cea-4034-b3a0-7d121eb20c89" returned: 0 in 0.271s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5cef980e-e137-4514-81ca-711dde947d06 tempest-VolumesActionsTest-801594599 None] Lock "cinder-quobyte-5ee65cbe-6cea-4034-b3a0-7d121eb20c89" released by "delete_volume" :: held 0.824s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-5cef980e-e137-4514-81ca-711dde947d06 tempest-VolumesActionsTest-801594599 None] Created reservations ['514d5e63-578d-40c8-8e45-35da90320a06', '515e1e91-82b3-4133-be07-b265178daed9', 'ded50fcb-351c-4e35-a7c3-638c31feb8f9', 'bbd0ce0d-773b-4d37-85ad-6ae7d9333c05'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5cef980e-e137-4514-81ca-711dde947d06 tempest-VolumesActionsTest-801594599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5cef980e-e137-4514-81ca-711dde947d06 tempest-VolumesActionsTest-801594599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5cef980e-e137-4514-81ca-711dde947d06 tempest-VolumesActionsTest-801594599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5cef980e-e137-4514-81ca-711dde947d06 tempest-VolumesActionsTest-801594599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5cef980e-e137-4514-81ca-711dde947d06 tempest-VolumesActionsTest-801594599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5cef980e-e137-4514-81ca-711dde947d06 tempest-VolumesActionsTest-801594599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:37 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:18:37 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:37 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5cef980e-e137-4514-81ca-711dde947d06 tempest-VolumesActionsTest-801594599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.276s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-5cef980e-e137-4514-81ca-711dde947d06 tempest-VolumesActionsTest-801594599 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:18:37 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-5cef980e-e137-4514-81ca-711dde947d06 tempest-VolumesActionsTest-801594599 None] Deleted volume successfully. Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5cef980e-e137-4514-81ca-711dde947d06 tempest-VolumesActionsTest-801594599 None] Lock "cinder-5ee65cbe-6cea-4034-b3a0-7d121eb20c89-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Flow 'volume_create_manager' (bbde28a8-63ff-46cb-acc0-cef11f5d98ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c0d6ea-be5b-40ed-a870-f65330ee37a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c0d6ea-be5b-40ed-a870-f65330ee37a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-447216340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c4aa921baf4991aaba1f0984260946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:18:38Z,use_quota=True,user_id='30a48a0ee1c540768971b344c3e84312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da022d39-6d05-48b0-ba8a-a07ad822bd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da022d39-6d05-48b0-ba8a-a07ad822bd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (137549a4-cd8c-47c0-a41d-0ef3b0cec474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (137549a4-cd8c-47c0-a41d-0ef3b0cec474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e', 'volume_name': 'volume-c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0d0da6-3899-44a4-9bd9-ac05fa4efe6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0d0da6-3899-44a4-9bd9-ac05fa4efe6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c3ebd9a-b777-4651-9402-b2ea4cb6e3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:37 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Volume c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e', 'volume_size': 1} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-447216340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c4aa921baf4991aaba1f0984260946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:18:38Z,use_quota=True,user_id='30a48a0ee1c540768971b344c3e84312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Creating volume c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:18:37 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-45094096-61ad-47bc-a921-c731052d9b4f tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:37 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e 1073741824 Jul 22 12:18:37 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:18:38 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Flow 'volume_create_manager' (9d29c53a-a7d2-4914-a5b7-4f4a5d29b02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77c22371-bb2f-4afe-ad0b-c388517b69fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e 1073741824" returned: 0 in 0.598s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77c22371-bb2f-4afe-ad0b-c388517b69fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-514856028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ffa528b-dd4f-444a-969f-6e12df931015,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f18dbab1b06b413eaf97890d9bb678b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:18:38Z,use_quota=True,user_id='460053ab3ac546b7a2c813ccf557f9d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63f10d1-0a3f-49ba-930c-e2d1377a4825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63f10d1-0a3f-49ba-930c-e2d1377a4825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d451ee7-c59e-489f-b917-38ef6215aab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d451ee7-c59e-489f-b917-38ef6215aab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ffa528b-dd4f-444a-969f-6e12df931015', 'volume_name': 'volume-6ffa528b-dd4f-444a-969f-6e12df931015', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5efab4dc-4d74-41b0-9c4c-f79741fef96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5efab4dc-4d74-41b0-9c4c-f79741fef96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b44b30a-0c1e-4996-a87d-567381eaec24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:38 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Volume 6ffa528b-dd4f-444a-969f-6e12df931015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ffa528b-dd4f-444a-969f-6e12df931015', 'volume_size': 1} Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:38 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e Jul 22 12:18:38 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:38 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e" returned: 0 in 0.280s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-45094096-61ad-47bc-a921-c731052d9b4f tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.930s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c3ebd9a-b777-4651-9402-b2ea4cb6e3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d29db2-8b1f-4e4d-ba2c-074451a573d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-45094096-61ad-47bc-a921-c731052d9b4f tempest-VolumesSnapshotTestJSON-493288019 None] Creating offline snapshot 904b296a-0885-498b-92e0-b1b3aa3c0db6 of volume cfb571be-aedf-41ac-beb0-065e3861717c {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:18:38 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Volume volume-c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e (c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e): created successfully Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d29db2-8b1f-4e4d-ba2c-074451a573d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Flow 'volume_create_manager' (bbde28a8-63ff-46cb-acc0-cef11f5d98ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[12aceca6-30ec-4e5b-aeb6-681c59ddb879]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-45094096-61ad-47bc-a921-c731052d9b4f tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:38 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-6ec031ff-7ccc-49a3-8b59-a6cfd0c47627 tempest-VolumesActionsTest-2008170282 None] Created volume successfully. Jul 22 12:18:39 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c Jul 22 12:18:39 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:39 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-45094096-61ad-47bc-a921-c731052d9b4f tempest-VolumesSnapshotTestJSON-493288019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c" returned: 0 in 0.406s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-45094096-61ad-47bc-a921-c731052d9b4f tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:39 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6 1G Jul 22 12:18:39 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:39 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-45094096-61ad-47bc-a921-c731052d9b4f tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6 1G" returned: 0 in 0.483s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-45094096-61ad-47bc-a921-c731052d9b4f tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfb571be-aedf-41ac-beb0-065e3861717c -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:39 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfb571be-aedf-41ac-beb0-065e3861717c -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6 Jul 22 12:18:39 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:40 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-45094096-61ad-47bc-a921-c731052d9b4f tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfb571be-aedf-41ac-beb0-065e3861717c -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6" returned: 0 in 0.428s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:40 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-45094096-61ad-47bc-a921-c731052d9b4f tempest-VolumesSnapshotTestJSON-493288019 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6 is being set with open permissions: ugo+rw Jul 22 12:18:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-45094096-61ad-47bc-a921-c731052d9b4f tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:40 devstack sudo[98039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6 Jul 22 12:18:40 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:40 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-45094096-61ad-47bc-a921-c731052d9b4f tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6" returned: 0 in 0.336s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-45094096-61ad-47bc-a921-c731052d9b4f tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:40 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.info Jul 22 12:18:40 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-95e39dd0-ba93-49f0-920d-acd8f231f3ff tempest-VolumesActionsTest-2008170282 None] Acquiring lock "cinder-c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-218238f8-452b-4752-9973-d110311b2181 req-b68f6348-3615-456a-bf9d-fa97b0e78ae4 tempest-TestShelveInstance-1552906758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-95e39dd0-ba93-49f0-920d-acd8f231f3ff tempest-VolumesActionsTest-2008170282 None] Lock "cinder-c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-95e39dd0-ba93-49f0-920d-acd8f231f3ff tempest-VolumesActionsTest-2008170282 None] Acquiring lock "cinder-quobyte-c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-95e39dd0-ba93-49f0-920d-acd8f231f3ff tempest-VolumesActionsTest-2008170282 None] Lock "cinder-quobyte-c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e" acquired by "delete_volume" :: waited 0.033s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:40 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[9528f76c-388d-417c-ac8a-09f0cf90a03f]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95e39dd0-ba93-49f0-920d-acd8f231f3ff tempest-VolumesActionsTest-2008170282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:40 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-45094096-61ad-47bc-a921-c731052d9b4f tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.info" returned: 0 in 0.327s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:40 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-45094096-61ad-47bc-a921-c731052d9b4f tempest-VolumesSnapshotTestJSON-493288019 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.info is being set with open permissions: ugo+rw Jul 22 12:18:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-45094096-61ad-47bc-a921-c731052d9b4f tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:40 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.info Jul 22 12:18:40 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:40 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e Jul 22 12:18:40 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:41 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-45094096-61ad-47bc-a921-c731052d9b4f tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.info" returned: 0 in 0.345s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-45094096-61ad-47bc-a921-c731052d9b4f tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.504s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.827s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:41 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-514856028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ffa528b-dd4f-444a-969f-6e12df931015,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f18dbab1b06b413eaf97890d9bb678b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:18:38Z,use_quota=True,user_id='460053ab3ac546b7a2c813ccf557f9d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Creating volume 6ffa528b-dd4f-444a-969f-6e12df931015 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:18:41 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6ffa528b-dd4f-444a-969f-6e12df931015 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95e39dd0-ba93-49f0-920d-acd8f231f3ff tempest-VolumesActionsTest-2008170282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e" returned: 0 in 0.539s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95e39dd0-ba93-49f0-920d-acd8f231f3ff tempest-VolumesActionsTest-2008170282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:41 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6ffa528b-dd4f-444a-969f-6e12df931015 1073741824 Jul 22 12:18:41 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:41 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-45094096-61ad-47bc-a921-c731052d9b4f tempest-VolumesSnapshotTestJSON-493288019 None] Create snapshot completed successfully Jul 22 12:18:41 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e Jul 22 12:18:41 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:41 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95e39dd0-ba93-49f0-920d-acd8f231f3ff tempest-VolumesActionsTest-2008170282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e" returned: 0 in 0.330s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-95e39dd0-ba93-49f0-920d-acd8f231f3ff tempest-VolumesActionsTest-2008170282 None] Lock "cinder-quobyte-c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e" released by "delete_volume" :: held 0.916s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-95e39dd0-ba93-49f0-920d-acd8f231f3ff tempest-VolumesActionsTest-2008170282 None] Created reservations ['8b8ce020-9d7a-436a-a75d-ffe8a02a88a1', '537bc641-c6a7-4192-969b-e1cab50576b0', '0dd1b45e-a99b-4ee5-80ba-f64dced24d57', '2ce580a7-3999-4aff-bb65-737cf8c40a6d'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-95e39dd0-ba93-49f0-920d-acd8f231f3ff tempest-VolumesActionsTest-2008170282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-95e39dd0-ba93-49f0-920d-acd8f231f3ff tempest-VolumesActionsTest-2008170282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-95e39dd0-ba93-49f0-920d-acd8f231f3ff tempest-VolumesActionsTest-2008170282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-95e39dd0-ba93-49f0-920d-acd8f231f3ff tempest-VolumesActionsTest-2008170282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-95e39dd0-ba93-49f0-920d-acd8f231f3ff tempest-VolumesActionsTest-2008170282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95e39dd0-ba93-49f0-920d-acd8f231f3ff tempest-VolumesActionsTest-2008170282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:41 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:18:41 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:41 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6ffa528b-dd4f-444a-969f-6e12df931015 1073741824" returned: 0 in 0.648s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6ffa528b-dd4f-444a-969f-6e12df931015 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:42 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6ffa528b-dd4f-444a-969f-6e12df931015 Jul 22 12:18:42 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:42 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95e39dd0-ba93-49f0-920d-acd8f231f3ff tempest-VolumesActionsTest-2008170282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.378s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:42 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-95e39dd0-ba93-49f0-920d-acd8f231f3ff tempest-VolumesActionsTest-2008170282 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:18:42 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-95e39dd0-ba93-49f0-920d-acd8f231f3ff tempest-VolumesActionsTest-2008170282 None] Deleted volume successfully. Jul 22 12:18:42 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-95e39dd0-ba93-49f0-920d-acd8f231f3ff tempest-VolumesActionsTest-2008170282 None] Lock "cinder-c88bfc1a-e2ca-405f-b71a-b0156e0e6d0e-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:42 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6ffa528b-dd4f-444a-969f-6e12df931015" returned: 0 in 0.423s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:18:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-218238f8-452b-4752-9973-d110311b2181 req-b68f6348-3615-456a-bf9d-fa97b0e78ae4 tempest-TestShelveInstance-1552906758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.760s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b44b30a-0c1e-4996-a87d-567381eaec24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ffa528b-dd4f-444a-969f-6e12df931015', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701ccedb-15d2-4e90-b987-1f72ff819dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-218238f8-452b-4752-9973-d110311b2181 req-b68f6348-3615-456a-bf9d-fa97b0e78ae4 tempest-TestShelveInstance-1552906758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.072s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:42 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Volume volume-6ffa528b-dd4f-444a-969f-6e12df931015 (6ffa528b-dd4f-444a-969f-6e12df931015): created successfully Jul 22 12:18:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701ccedb-15d2-4e90-b987-1f72ff819dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Flow 'volume_create_manager' (9d29c53a-a7d2-4914-a5b7-4f4a5d29b02e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:18:42 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e7afb3e8-e1cf-411f-ae24-cc94ab45b6cd tempest-VolumesGetTest-991120179 None] Created volume successfully. Jul 22 12:18:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-218238f8-452b-4752-9973-d110311b2181 req-b68f6348-3615-456a-bf9d-fa97b0e78ae4 tempest-TestShelveInstance-1552906758 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29', 'name': 'volume-1b262626-0dbe-4fb5-853e-06bac1abac7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6e6af74-16c3-4fbe-8af0-d5fe7dde46a7', 'enforce_multipath': True} {{(pid=87568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 12:18:42 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-218238f8-452b-4752-9973-d110311b2181 req-b68f6348-3615-456a-bf9d-fa97b0e78ae4 tempest-TestShelveInstance-1552906758 None] attachment_update completed successfully. Jul 22 12:18:42 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Flow 'volume_create_manager' (8653f2b0-b7db-45a8-8091-1b62b58c0df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66bf88c-71ac-4833-9a9c-7c91c98539fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66bf88c-71ac-4833-9a9c-7c91c98539fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1606620990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7203801-2f3a-4540-b9d9-e11a6699c493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d049f95ddde4ba09b45711208c08bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:18:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=904b296a-0885-498b-92e0-b1b3aa3c0db6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:18:43Z,use_quota=True,user_id='632f3d946ce143c2ad87ebd720469102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1442e1-ecb0-45f8-a347-8e0111098ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1442e1-ecb0-45f8-a347-8e0111098ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c44624c0-ca15-4eab-8dd8-3e0409e2d2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c44624c0-ca15-4eab-8dd8-3e0409e2d2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e7203801-2f3a-4540-b9d9-e11a6699c493', 'volume_name': 'volume-e7203801-2f3a-4540-b9d9-e11a6699c493', 'volume_size': 2, 'snapshot_id': '904b296a-0885-498b-92e0-b1b3aa3c0db6'}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6f7f6f-02c8-4da0-8ccc-39b059c61507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6f7f6f-02c8-4da0-8ccc-39b059c61507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e01c76a3-a950-497a-aabd-dd4c1d52b550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:43 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Volume e7203801-2f3a-4540-b9d9-e11a6699c493: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e7203801-2f3a-4540-b9d9-e11a6699c493', 'volume_size': 2, 'snapshot_id': '904b296a-0885-498b-92e0-b1b3aa3c0db6'} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-quobyte-904b296a-0885-498b-92e0-b1b3aa3c0db6-e7203801-2f3a-4540-b9d9-e11a6699c493" by "_create_volume_from_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-904b296a-0885-498b-92e0-b1b3aa3c0db6-e7203801-2f3a-4540-b9d9-e11a6699c493" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Creating volume e7203801-2f3a-4540-b9d9-e11a6699c493 from snapshot 904b296a-0885-498b-92e0-b1b3aa3c0db6 {{(pid=87568) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-quobyte-e7203801-2f3a-4540-b9d9-e11a6699c493" by "_copy_volume_from_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-e7203801-2f3a-4540-b9d9-e11a6699c493" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] snapshot: 904b296a-0885-498b-92e0-b1b3aa3c0db6, volume: e7203801-2f3a-4540-b9d9-e11a6699c493, {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f4cc08-821f-4de9-9809-c8eca84403ff]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:43 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6 Jul 22 12:18:43 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:43 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6" returned: 0 in 0.458s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfb571be-aedf-41ac-beb0-065e3861717c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] will copy from snapshot at /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Creating direct copy from snapshot {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdadcdd4-637e-44c9-b54e-913bf45148a7]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:18:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Flow 'volume_create_manager' (82481f11-3c5a-4625-912b-6560243033fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:18:44 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dcc996e-3898-4dae-94d9-3304cec74ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:44 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c Jul 22 12:18:44 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:44 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dcc996e-3898-4dae-94d9-3304cec74ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:18:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1625589916',display_name='tempest-VolumesGetTest-Volume-1140245399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecccb019-1d5e-4714-a1ea-99924d1549db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18dbab1b06b413eaf97890d9bb678b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:18:44Z,use_quota=True,user_id='460053ab3ac546b7a2c813ccf557f9d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:44 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4a5586-6010-4431-bb7f-c1cd0ec7c320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:44 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4a5586-6010-4431-bb7f-c1cd0ec7c320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:44 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736f36b3-9e16-4037-b5d8-300939e1c9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:44 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736f36b3-9e16-4037-b5d8-300939e1c9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecccb019-1d5e-4714-a1ea-99924d1549db', 'volume_name': 'volume-ecccb019-1d5e-4714-a1ea-99924d1549db', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:44 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c07ea68-316b-4f6d-97d4-1946a92cc8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:44 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c07ea68-316b-4f6d-97d4-1946a92cc8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:44 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3dce41b-7ced-41cd-b41a-12e0715120e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:44 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Volume ecccb019-1d5e-4714-a1ea-99924d1549db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecccb019-1d5e-4714-a1ea-99924d1549db', 'volume_size': 1} Jul 22 12:18:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c" returned: 0 in 0.557s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:44 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:44 devstack cinder-volume[87568]: DEBUG cinder.utils [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Path /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e7203801-2f3a-4540-b9d9-e11a6699c493 not found in is_blk_device check {{(pid=87568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 12:18:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e7203801-2f3a-4540-b9d9-e11a6699c493 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:44 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e7203801-2f3a-4540-b9d9-e11a6699c493 Jul 22 12:18:44 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:52 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e7203801-2f3a-4540-b9d9-e11a6699c493" returned: 0 in 7.737s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:52 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48a1d9d-dbbb-452a-9d49-6cbcbd900a75]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:52 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c Jul 22 12:18:52 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:53 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c" returned: 0 in 0.900s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:53 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Image conversion details: src /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c, size 1024.00 MB, duration 7.74 sec, destination /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e7203801-2f3a-4540-b9d9-e11a6699c493 {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:18:53 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Converted 1024.00 MB image at 132.33 MB/s Jul 22 12:18:53 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e7203801-2f3a-4540-b9d9-e11a6699c493 is being set with open permissions: ugo+rw Jul 22 12:18:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e7203801-2f3a-4540-b9d9-e11a6699c493 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:53 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e7203801-2f3a-4540-b9d9-e11a6699c493 Jul 22 12:18:53 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:53 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=84,cinder:UPDATE=75,cinder:DELETE=6,cinder:INSERT=22 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:18:53 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e7203801-2f3a-4540-b9d9-e11a6699c493" returned: 0 in 0.400s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:53 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-e7203801-2f3a-4540-b9d9-e11a6699c493" released by "_copy_volume_from_snapshot" :: held 10.202s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:53 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-904b296a-0885-498b-92e0-b1b3aa3c0db6-e7203801-2f3a-4540-b9d9-e11a6699c493" released by "_create_volume_from_snapshot" :: held 10.266s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.311s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.440s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:18:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1625589916',display_name='tempest-VolumesGetTest-Volume-1140245399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecccb019-1d5e-4714-a1ea-99924d1549db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18dbab1b06b413eaf97890d9bb678b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:18:44Z,use_quota=True,user_id='460053ab3ac546b7a2c813ccf557f9d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:18:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Creating volume ecccb019-1d5e-4714-a1ea-99924d1549db {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:18:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:18:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:18:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:18:53 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:18:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ecccb019-1d5e-4714-a1ea-99924d1549db 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:53 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ecccb019-1d5e-4714-a1ea-99924d1549db 1073741824 Jul 22 12:18:53 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e01c76a3-a950-497a-aabd-dd4c1d52b550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7203801-2f3a-4540-b9d9-e11a6699c493', 'volume_size': 2, 'snapshot_id': '904b296a-0885-498b-92e0-b1b3aa3c0db6'}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3509b2-c8b8-45a7-bc97-40320cccecd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:53 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Volume volume-e7203801-2f3a-4540-b9d9-e11a6699c493 (e7203801-2f3a-4540-b9d9-e11a6699c493): created successfully Jul 22 12:18:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3509b2-c8b8-45a7-bc97-40320cccecd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Flow 'volume_create_manager' (8653f2b0-b7db-45a8-8091-1b62b58c0df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:18:53 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-bfd92531-d804-48eb-8bc0-88ab5abdd04f tempest-VolumesSnapshotTestJSON-493288019 None] Created volume successfully. Jul 22 12:18:54 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ecccb019-1d5e-4714-a1ea-99924d1549db 1073741824" returned: 0 in 0.843s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ecccb019-1d5e-4714-a1ea-99924d1549db {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:54 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ecccb019-1d5e-4714-a1ea-99924d1549db Jul 22 12:18:54 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:54 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-384c6c77-485f-4cf4-9526-b59378c34f2c tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-e7203801-2f3a-4540-b9d9-e11a6699c493-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:54 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-384c6c77-485f-4cf4-9526-b59378c34f2c tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-e7203801-2f3a-4540-b9d9-e11a6699c493-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-384c6c77-485f-4cf4-9526-b59378c34f2c tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-quobyte-e7203801-2f3a-4540-b9d9-e11a6699c493" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:55 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ecccb019-1d5e-4714-a1ea-99924d1549db" returned: 0 in 0.593s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:55 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:18:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-384c6c77-485f-4cf4-9526-b59378c34f2c tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-e7203801-2f3a-4540-b9d9-e11a6699c493" acquired by "delete_volume" :: waited 0.026s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3dce41b-7ced-41cd-b41a-12e0715120e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecccb019-1d5e-4714-a1ea-99924d1549db', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c787309-b837-4c59-af26-ef49d0485f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:18:55 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a7267b-6053-4ebd-8f4a-e4e94069facb]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-384c6c77-485f-4cf4-9526-b59378c34f2c tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e7203801-2f3a-4540-b9d9-e11a6699c493 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:55 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Volume volume-ecccb019-1d5e-4714-a1ea-99924d1549db (ecccb019-1d5e-4714-a1ea-99924d1549db): created successfully Jul 22 12:18:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c787309-b837-4c59-af26-ef49d0485f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:18:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Flow 'volume_create_manager' (82481f11-3c5a-4625-912b-6560243033fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:18:55 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-3a6e38dd-1ebf-4338-9f62-b2d21fce3e2c tempest-VolumesGetTest-991120179 None] Created volume successfully. Jul 22 12:18:55 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e7203801-2f3a-4540-b9d9-e11a6699c493 Jul 22 12:18:55 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:55 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-384c6c77-485f-4cf4-9526-b59378c34f2c tempest-VolumesSnapshotTestJSON-493288019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e7203801-2f3a-4540-b9d9-e11a6699c493" returned: 0 in 0.500s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-384c6c77-485f-4cf4-9526-b59378c34f2c tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e7203801-2f3a-4540-b9d9-e11a6699c493 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:55 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e7203801-2f3a-4540-b9d9-e11a6699c493 Jul 22 12:18:55 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:55 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-384c6c77-485f-4cf4-9526-b59378c34f2c tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e7203801-2f3a-4540-b9d9-e11a6699c493" returned: 0 in 0.338s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-384c6c77-485f-4cf4-9526-b59378c34f2c tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-e7203801-2f3a-4540-b9d9-e11a6699c493" released by "delete_volume" :: held 0.920s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:56 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-384c6c77-485f-4cf4-9526-b59378c34f2c tempest-VolumesSnapshotTestJSON-493288019 None] Created reservations ['de354bf2-7137-4133-9cd2-baa4ba192d96', 'aa658322-e162-4f8a-b08a-82d380ebe3bd', '22868c7b-abd4-40d1-918e-faf42cd797b3', '10526cb7-1758-4325-b83b-22de51ca5826'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:18:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6bde740c-3d69-4c2f-9062-ffd54003c963 tempest-VolumesGetTest-991120179 None] Acquiring lock "cinder-ecccb019-1d5e-4714-a1ea-99924d1549db-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6bde740c-3d69-4c2f-9062-ffd54003c963 tempest-VolumesGetTest-991120179 None] Lock "cinder-ecccb019-1d5e-4714-a1ea-99924d1549db-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-384c6c77-485f-4cf4-9526-b59378c34f2c tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-384c6c77-485f-4cf4-9526-b59378c34f2c tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:56 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-384c6c77-485f-4cf4-9526-b59378c34f2c tempest-VolumesSnapshotTestJSON-493288019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:18:56 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-384c6c77-485f-4cf4-9526-b59378c34f2c tempest-VolumesSnapshotTestJSON-493288019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:18:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-384c6c77-485f-4cf4-9526-b59378c34f2c tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-384c6c77-485f-4cf4-9526-b59378c34f2c tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6bde740c-3d69-4c2f-9062-ffd54003c963 tempest-VolumesGetTest-991120179 None] Acquiring lock "cinder-quobyte-ecccb019-1d5e-4714-a1ea-99924d1549db" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:56 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:18:56 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6bde740c-3d69-4c2f-9062-ffd54003c963 tempest-VolumesGetTest-991120179 None] Lock "cinder-quobyte-ecccb019-1d5e-4714-a1ea-99924d1549db" acquired by "delete_volume" :: waited 0.060s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:56 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[206584df-a6d2-4985-8f2d-d6acaaab9170]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6bde740c-3d69-4c2f-9062-ffd54003c963 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ecccb019-1d5e-4714-a1ea-99924d1549db {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:56 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-384c6c77-485f-4cf4-9526-b59378c34f2c tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.418s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:56 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-384c6c77-485f-4cf4-9526-b59378c34f2c tempest-VolumesSnapshotTestJSON-493288019 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:18:56 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-384c6c77-485f-4cf4-9526-b59378c34f2c tempest-VolumesSnapshotTestJSON-493288019 None] Deleted volume successfully. Jul 22 12:18:56 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ecccb019-1d5e-4714-a1ea-99924d1549db Jul 22 12:18:56 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-384c6c77-485f-4cf4-9526-b59378c34f2c tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-e7203801-2f3a-4540-b9d9-e11a6699c493-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:57 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6bde740c-3d69-4c2f-9062-ffd54003c963 tempest-VolumesGetTest-991120179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ecccb019-1d5e-4714-a1ea-99924d1549db" returned: 0 in 0.727s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6bde740c-3d69-4c2f-9062-ffd54003c963 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ecccb019-1d5e-4714-a1ea-99924d1549db {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:57 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ecccb019-1d5e-4714-a1ea-99924d1549db Jul 22 12:18:57 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e2e9cdb2-f7bc-4997-a72e-f98b840fd932 tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-904b296a-0885-498b-92e0-b1b3aa3c0db6-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e2e9cdb2-f7bc-4997-a72e-f98b840fd932 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-904b296a-0885-498b-92e0-b1b3aa3c0db6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e2e9cdb2-f7bc-4997-a72e-f98b840fd932 tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-quobyte-cfb571be-aedf-41ac-beb0-065e3861717c" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e2e9cdb2-f7bc-4997-a72e-f98b840fd932 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-cfb571be-aedf-41ac-beb0-065e3861717c" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e2e9cdb2-f7bc-4997-a72e-f98b840fd932 tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-quobyte-904b296a-0885-498b-92e0-b1b3aa3c0db6" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e2e9cdb2-f7bc-4997-a72e-f98b840fd932 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-904b296a-0885-498b-92e0-b1b3aa3c0db6" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-e2e9cdb2-f7bc-4997-a72e-f98b840fd932 tempest-VolumesSnapshotTestJSON-493288019 None] Deleting offline snapshot 904b296a-0885-498b-92e0-b1b3aa3c0db6 of volume cfb571be-aedf-41ac-beb0-065e3861717c {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-e2e9cdb2-f7bc-4997-a72e-f98b840fd932 tempest-VolumesSnapshotTestJSON-493288019 None] snapshot_file for this snap is: volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0ba545-97d9-4d05-ba4c-9949ffeb7dfc]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e2e9cdb2-f7bc-4997-a72e-f98b840fd932 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:57 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6bde740c-3d69-4c2f-9062-ffd54003c963 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ecccb019-1d5e-4714-a1ea-99924d1549db" returned: 0 in 0.353s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6bde740c-3d69-4c2f-9062-ffd54003c963 tempest-VolumesGetTest-991120179 None] Lock "cinder-quobyte-ecccb019-1d5e-4714-a1ea-99924d1549db" released by "delete_volume" :: held 1.145s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:57 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6 Jul 22 12:18:57 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-6bde740c-3d69-4c2f-9062-ffd54003c963 tempest-VolumesGetTest-991120179 None] Created reservations ['aa6cde10-4a3c-456b-850f-6ba5b6b961cb', 'a09cf75b-0d16-477d-86b7-527260ad8ca3', '1ef5e2ad-a648-4eb4-9615-20ecd7c3577b', 'fa4070ad-2ac0-45dd-a0c4-e25b87edca21'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6bde740c-3d69-4c2f-9062-ffd54003c963 tempest-VolumesGetTest-991120179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6bde740c-3d69-4c2f-9062-ffd54003c963 tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6bde740c-3d69-4c2f-9062-ffd54003c963 tempest-VolumesGetTest-991120179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6bde740c-3d69-4c2f-9062-ffd54003c963 tempest-VolumesGetTest-991120179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6bde740c-3d69-4c2f-9062-ffd54003c963 tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6bde740c-3d69-4c2f-9062-ffd54003c963 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:57 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:18:57 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:57 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e2e9cdb2-f7bc-4997-a72e-f98b840fd932 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6" returned: 0 in 0.460s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-e2e9cdb2-f7bc-4997-a72e-f98b840fd932 tempest-VolumesSnapshotTestJSON-493288019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfb571be-aedf-41ac-beb0-065e3861717c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:18:58 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb73e55-b690-45e3-ab9a-38106232f767]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e2e9cdb2-f7bc-4997-a72e-f98b840fd932 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:58 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6bde740c-3d69-4c2f-9062-ffd54003c963 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.388s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:58 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-6bde740c-3d69-4c2f-9062-ffd54003c963 tempest-VolumesGetTest-991120179 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:18:58 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-6bde740c-3d69-4c2f-9062-ffd54003c963 tempest-VolumesGetTest-991120179 None] Deleted volume successfully. Jul 22 12:18:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6bde740c-3d69-4c2f-9062-ffd54003c963 tempest-VolumesGetTest-991120179 None] Lock "cinder-ecccb019-1d5e-4714-a1ea-99924d1549db-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:58 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c Jul 22 12:18:58 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:58 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e2e9cdb2-f7bc-4997-a72e-f98b840fd932 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c" returned: 0 in 0.448s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e2e9cdb2-f7bc-4997-a72e-f98b840fd932 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:58 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6 Jul 22 12:18:58 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e36ff5d6-57f6-4942-ba0e-65c4b250ade2 tempest-VolumesGetTest-991120179 None] Acquiring lock "cinder-6ffa528b-dd4f-444a-969f-6e12df931015-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e36ff5d6-57f6-4942-ba0e-65c4b250ade2 tempest-VolumesGetTest-991120179 None] Lock "cinder-6ffa528b-dd4f-444a-969f-6e12df931015-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e36ff5d6-57f6-4942-ba0e-65c4b250ade2 tempest-VolumesGetTest-991120179 None] Acquiring lock "cinder-quobyte-6ffa528b-dd4f-444a-969f-6e12df931015" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:18:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e36ff5d6-57f6-4942-ba0e-65c4b250ade2 tempest-VolumesGetTest-991120179 None] Lock "cinder-quobyte-6ffa528b-dd4f-444a-969f-6e12df931015" acquired by "delete_volume" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:18:58 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c31122c-4c87-4d91-ad59-1aceb5df0edf]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:18:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e36ff5d6-57f6-4942-ba0e-65c4b250ade2 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6ffa528b-dd4f-444a-969f-6e12df931015 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:58 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6ffa528b-dd4f-444a-969f-6e12df931015 Jul 22 12:18:58 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:58 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e2e9cdb2-f7bc-4997-a72e-f98b840fd932 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6" returned: 0 in 0.501s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e2e9cdb2-f7bc-4997-a72e-f98b840fd932 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:59 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6 Jul 22 12:18:59 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:59 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e36ff5d6-57f6-4942-ba0e-65c4b250ade2 tempest-VolumesGetTest-991120179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6ffa528b-dd4f-444a-969f-6e12df931015" returned: 0 in 0.473s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e36ff5d6-57f6-4942-ba0e-65c4b250ade2 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6ffa528b-dd4f-444a-969f-6e12df931015 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:59 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e2e9cdb2-f7bc-4997-a72e-f98b840fd932 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c.904b296a-0885-498b-92e0-b1b3aa3c0db6" returned: 0 in 0.355s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:59 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6ffa528b-dd4f-444a-969f-6e12df931015 Jul 22 12:18:59 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:18:59 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e2e9cdb2-f7bc-4997-a72e-f98b840fd932 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-904b296a-0885-498b-92e0-b1b3aa3c0db6" released by "_delete_snapshot" :: held 1.985s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:59 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e2e9cdb2-f7bc-4997-a72e-f98b840fd932 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-cfb571be-aedf-41ac-beb0-065e3861717c" released by "delete_snapshot" :: held 2.057s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:59 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-e2e9cdb2-f7bc-4997-a72e-f98b840fd932 tempest-VolumesSnapshotTestJSON-493288019 None] Created reservations ['2c0c9276-9a8b-4d7b-93ed-d8ee14144b60', 'cd2d4122-8f6d-40ed-a7d2-1090b9e358d2', '8db8d715-600e-4af2-b24a-ae8803b0840e', '802fc884-e293-4614-9d9c-961ff1358e9c'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:18:59 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e2e9cdb2-f7bc-4997-a72e-f98b840fd932 tempest-VolumesSnapshotTestJSON-493288019 None] Delete snapshot completed successfully. Jul 22 12:18:59 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e2e9cdb2-f7bc-4997-a72e-f98b840fd932 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-904b296a-0885-498b-92e0-b1b3aa3c0db6-delete_snapshot" released by "delete_snapshot" :: held 2.281s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:59 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Jul 22 12:18:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e36ff5d6-57f6-4942-ba0e-65c4b250ade2 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6ffa528b-dd4f-444a-969f-6e12df931015" returned: 0 in 0.362s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:18:59 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e36ff5d6-57f6-4942-ba0e-65c4b250ade2 tempest-VolumesGetTest-991120179 None] Lock "cinder-quobyte-6ffa528b-dd4f-444a-969f-6e12df931015" released by "delete_volume" :: held 0.881s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:18:59 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-e36ff5d6-57f6-4942-ba0e-65c4b250ade2 tempest-VolumesGetTest-991120179 None] Created reservations ['5aff58be-8779-4752-b2b9-f745e2091a3b', 'ec0dd80e-9c75-4fc9-a98e-354c0679b0e0', 'e6bfe9f2-9b1d-45a9-83d7-c39e8d8562e4', '3c3b3e1c-2529-4653-855b-43990c5b88c3'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:18:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e36ff5d6-57f6-4942-ba0e-65c4b250ade2 tempest-VolumesGetTest-991120179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:18:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e36ff5d6-57f6-4942-ba0e-65c4b250ade2 tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:18:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e36ff5d6-57f6-4942-ba0e-65c4b250ade2 tempest-VolumesGetTest-991120179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:18:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e36ff5d6-57f6-4942-ba0e-65c4b250ade2 tempest-VolumesGetTest-991120179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:18:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e36ff5d6-57f6-4942-ba0e-65c4b250ade2 tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:18:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e36ff5d6-57f6-4942-ba0e-65c4b250ade2 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:18:59 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:18:59 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:00 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e36ff5d6-57f6-4942-ba0e-65c4b250ade2 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.311s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-e36ff5d6-57f6-4942-ba0e-65c4b250ade2 tempest-VolumesGetTest-991120179 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:19:00 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e36ff5d6-57f6-4942-ba0e-65c4b250ade2 tempest-VolumesGetTest-991120179 None] Deleted volume successfully. Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e36ff5d6-57f6-4942-ba0e-65c4b250ade2 tempest-VolumesGetTest-991120179 None] Lock "cinder-6ffa528b-dd4f-444a-969f-6e12df931015-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Flow 'volume_create_manager' (0c8626ef-32a4-4fca-ba6e-6896250a36bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b840f63a-cec0-48f7-b296-286ec88e7e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b840f63a-cec0-48f7-b296-286ec88e7e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1049244751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a2f5d9-b305-43ac-a859-04a0d51e392d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18dbab1b06b413eaf97890d9bb678b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:00Z,use_quota=True,user_id='460053ab3ac546b7a2c813ccf557f9d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9725cfc8-bac8-4959-819e-e0183e94c83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9725cfc8-bac8-4959-819e-e0183e94c83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8784219-652a-4cf3-81e8-ca43a365a992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8784219-652a-4cf3-81e8-ca43a365a992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4a2f5d9-b305-43ac-a859-04a0d51e392d', 'volume_name': 'volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fdeba99-b63d-4263-9c55-7aab257dd469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fdeba99-b63d-4263-9c55-7aab257dd469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2bde51-669c-4440-bc2d-032390895c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:00 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Volume e4a2f5d9-b305-43ac-a859-04a0d51e392d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d', 'volume_size': 1} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1049244751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a2f5d9-b305-43ac-a859-04a0d51e392d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18dbab1b06b413eaf97890d9bb678b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:00Z,use_quota=True,user_id='460053ab3ac546b7a2c813ccf557f9d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Creating volume e4a2f5d9-b305-43ac-a859-04a0d51e392d {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:19:00 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-411f45b0-826a-4e68-8423-5fc9b8620c3b tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-cfb571be-aedf-41ac-beb0-065e3861717c-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:00 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d 1073741824 Jul 22 12:19:00 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-411f45b0-826a-4e68-8423-5fc9b8620c3b tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-cfb571be-aedf-41ac-beb0-065e3861717c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-411f45b0-826a-4e68-8423-5fc9b8620c3b tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-quobyte-cfb571be-aedf-41ac-beb0-065e3861717c" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-411f45b0-826a-4e68-8423-5fc9b8620c3b tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-cfb571be-aedf-41ac-beb0-065e3861717c" acquired by "delete_volume" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2248e9-a798-4490-bccd-d56fe7b311aa]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-411f45b0-826a-4e68-8423-5fc9b8620c3b tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:00 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c Jul 22 12:19:00 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:01 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d 1073741824" returned: 0 in 0.541s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:01 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d Jul 22 12:19:01 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:01 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-411f45b0-826a-4e68-8423-5fc9b8620c3b tempest-VolumesSnapshotTestJSON-493288019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c" returned: 0 in 0.480s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-411f45b0-826a-4e68-8423-5fc9b8620c3b tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:01 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c Jul 22 12:19:01 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:01 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d" returned: 0 in 0.355s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:19:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2bde51-669c-4440-bc2d-032390895c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f78ac43-56b5-46fe-944c-b2dcfef9bea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:01 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Volume volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d (e4a2f5d9-b305-43ac-a859-04a0d51e392d): created successfully Jul 22 12:19:01 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f78ac43-56b5-46fe-944c-b2dcfef9bea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Flow 'volume_create_manager' (0c8626ef-32a4-4fca-ba6e-6896250a36bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-411f45b0-826a-4e68-8423-5fc9b8620c3b tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cfb571be-aedf-41ac-beb0-065e3861717c" returned: 0 in 0.336s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:01 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-78361689-77f8-454b-a82c-3b1f5bd58030 tempest-VolumesGetTest-991120179 None] Created volume successfully. Jul 22 12:19:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-411f45b0-826a-4e68-8423-5fc9b8620c3b tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-cfb571be-aedf-41ac-beb0-065e3861717c" released by "delete_volume" :: held 0.891s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:01 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-411f45b0-826a-4e68-8423-5fc9b8620c3b tempest-VolumesSnapshotTestJSON-493288019 None] Created reservations ['0984d445-21f8-4eb2-b5f8-ca8c107d2c76', 'beb5125f-8817-4a63-942c-5327bb51e54b', '7c3020a8-f282-4225-9a54-48d23e10ef16', '109883d3-291a-47a3-b26b-5abcfd9c87b4'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:19:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-411f45b0-826a-4e68-8423-5fc9b8620c3b tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-411f45b0-826a-4e68-8423-5fc9b8620c3b tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-411f45b0-826a-4e68-8423-5fc9b8620c3b tempest-VolumesSnapshotTestJSON-493288019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-411f45b0-826a-4e68-8423-5fc9b8620c3b tempest-VolumesSnapshotTestJSON-493288019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-411f45b0-826a-4e68-8423-5fc9b8620c3b tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-411f45b0-826a-4e68-8423-5fc9b8620c3b tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:01 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:19:01 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:02 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-411f45b0-826a-4e68-8423-5fc9b8620c3b tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.278s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:02 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-411f45b0-826a-4e68-8423-5fc9b8620c3b tempest-VolumesSnapshotTestJSON-493288019 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:19:02 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-411f45b0-826a-4e68-8423-5fc9b8620c3b tempest-VolumesSnapshotTestJSON-493288019 None] Deleted volume successfully. Jul 22 12:19:02 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-411f45b0-826a-4e68-8423-5fc9b8620c3b tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-cfb571be-aedf-41ac-beb0-065e3861717c-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Flow 'volume_create_manager' (a50619da-d44e-4a19-8ab5-863ad2efb41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61319aa-ac4a-44b9-b1a5-1e8337a871ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61319aa-ac4a-44b9-b1a5-1e8337a871ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-333994809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d9165ab-9da2-4dd5-a6ab-400cbc62c696,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f18dbab1b06b413eaf97890d9bb678b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e4a2f5d9-b305-43ac-a859-04a0d51e392d,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:03Z,use_quota=True,user_id='460053ab3ac546b7a2c813ccf557f9d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a2a729-b1d8-4e0a-bcc4-7bda88d90b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a2a729-b1d8-4e0a-bcc4-7bda88d90b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62ec910-c059-4a52-93a8-9453f2fcea4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62ec910-c059-4a52-93a8-9453f2fcea4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4d9165ab-9da2-4dd5-a6ab-400cbc62c696', 'volume_name': 'volume-4d9165ab-9da2-4dd5-a6ab-400cbc62c696', 'volume_size': 1, 'source_volid': 'e4a2f5d9-b305-43ac-a859-04a0d51e392d', 'source_volstatus': 'available'}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b656ad4d-84af-4a87-beb8-81608308dfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b656ad4d-84af-4a87-beb8-81608308dfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (856e2965-a561-46d3-b075-e86bddeb3763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:03 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Volume 4d9165ab-9da2-4dd5-a6ab-400cbc62c696: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4d9165ab-9da2-4dd5-a6ab-400cbc62c696', 'volume_size': 1, 'source_volid': 'e4a2f5d9-b305-43ac-a859-04a0d51e392d', 'source_volstatus': 'available'} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:03 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Cloning volume e4a2f5d9-b305-43ac-a859-04a0d51e392d to volume 4d9165ab-9da2-4dd5-a6ab-400cbc62c696 Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Creating offline snapshot 8d70f8af-b552-4fd9-a95c-0a68a8867cab of volume e4a2f5d9-b305-43ac-a859-04a0d51e392d {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d400b7d-9c5c-4ba5-b841-ca5943a0c8e4]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:03 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d Jul 22 12:19:03 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:UPDATE=123,cinder:SELECT=104,cinder:INSERT=36,cinder:DELETE=12 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Flow 'volume_create_manager' (e1d70f02-7f69-45ff-8a18-ba54c40adb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e1d716-6df9-41fd-9c39-3457ac94c393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e1d716-6df9-41fd-9c39-3457ac94c393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-139503316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa761ad-3c04-4072-b1f5-7c415b2d56ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d049f95ddde4ba09b45711208c08bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:04Z,use_quota=True,user_id='632f3d946ce143c2ad87ebd720469102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b8df12-fea8-4d9c-a08b-a60d6944a375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b8df12-fea8-4d9c-a08b-a60d6944a375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e4e404-f37a-45e2-8e56-8cf1ed7f83c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e4e404-f37a-45e2-8e56-8cf1ed7f83c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fa761ad-3c04-4072-b1f5-7c415b2d56ff', 'volume_name': 'volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38833927-9130-4f84-b222-2c2547562ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38833927-9130-4f84-b222-2c2547562ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb475308-601e-46f8-a086-966d12e7a8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:03 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Volume 5fa761ad-3c04-4072-b1f5-7c415b2d56ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff', 'volume_size': 1} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:03 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d" returned: 0 in 0.408s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:04 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab 1G Jul 22 12:19:04 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:04 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:19:04 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Flow 'volume_create_manager' (fa2a9ee5-4c57-485b-8e2f-1f576836d544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:04 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77424c81-2c82-480d-833f-8354b4bc0352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:04 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77424c81-2c82-480d-833f-8354b4bc0352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1814739760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048f7ce0-7514-4dde-915f-b004bf5ec8fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ecf6b24e8914283a5984e68bd9974a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:04Z,use_quota=True,user_id='6118441674a84cdfb684f2de2bb88231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:04 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (574a85d9-5b99-48e9-af7e-309a974d89d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:04 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (574a85d9-5b99-48e9-af7e-309a974d89d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:04 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a20135e-363d-432b-a585-8d0ae6abaed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:04 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a20135e-363d-432b-a585-8d0ae6abaed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '048f7ce0-7514-4dde-915f-b004bf5ec8fb', 'volume_name': 'volume-048f7ce0-7514-4dde-915f-b004bf5ec8fb', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:04 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63baa817-4716-4766-b265-428f1d621f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:04 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63baa817-4716-4766-b265-428f1d621f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:04 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a81d11b-581b-40b3-af71-dcf9c02321d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:04 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Volume 048f7ce0-7514-4dde-915f-b004bf5ec8fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-048f7ce0-7514-4dde-915f-b004bf5ec8fb', 'volume_size': 1} Jul 22 12:19:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:04 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab 1G" returned: 0 in 0.612s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:04 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab Jul 22 12:19:04 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:04 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab" returned: 0 in 0.367s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:04 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab is being set with open permissions: ugo+rw Jul 22 12:19:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:04 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab Jul 22 12:19:04 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:05 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab" returned: 0 in 0.250s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:05 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.info Jul 22 12:19:05 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:05 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.info" returned: 0 in 0.280s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:05 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.info is being set with open permissions: ugo+rw Jul 22 12:19:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:05 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.info Jul 22 12:19:05 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:05 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.info" returned: 0 in 0.277s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Acquiring lock "cinder-quobyte-4d9165ab-9da2-4dd5-a6ab-400cbc62c696" by "_copy_volume_from_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Lock "cinder-quobyte-4d9165ab-9da2-4dd5-a6ab-400cbc62c696" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:05 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] snapshot: 8d70f8af-b552-4fd9-a95c-0a68a8867cab, volume: 4d9165ab-9da2-4dd5-a6ab-400cbc62c696, {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 12:19:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:05 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:05 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:05 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c1497b-bae0-47a0-acb6-0bbd2601d87a]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:05 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab Jul 22 12:19:05 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:06 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab" returned: 0 in 0.353s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:19:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] will copy from snapshot at /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 12:19:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Creating direct copy from snapshot {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 12:19:06 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cfa455-d642-4cf4-83b9-b5b636ee124d]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:06 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d Jul 22 12:19:06 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:06 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d" returned: 0 in 0.368s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:06 devstack cinder-volume[87568]: DEBUG cinder.utils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Path /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d9165ab-9da2-4dd5-a6ab-400cbc62c696 not found in is_blk_device check {{(pid=87568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 12:19:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d9165ab-9da2-4dd5-a6ab-400cbc62c696 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:06 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d9165ab-9da2-4dd5-a6ab-400cbc62c696 Jul 22 12:19:06 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:10 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d9165ab-9da2-4dd5-a6ab-400cbc62c696" returned: 0 in 4.278s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:10 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[392a310e-9f15-42a9-8b86-fd6de456f8dd]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:11 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d Jul 22 12:19:11 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:11 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d" returned: 0 in 0.533s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:11 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Image conversion details: src /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d, size 1024.00 MB, duration 4.28 sec, destination /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d9165ab-9da2-4dd5-a6ab-400cbc62c696 {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:19:11 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Converted 1024.00 MB image at 239.23 MB/s Jul 22 12:19:11 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d9165ab-9da2-4dd5-a6ab-400cbc62c696 is being set with open permissions: ugo+rw Jul 22 12:19:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d9165ab-9da2-4dd5-a6ab-400cbc62c696 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:11 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d9165ab-9da2-4dd5-a6ab-400cbc62c696 Jul 22 12:19:11 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:11 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d9165ab-9da2-4dd5-a6ab-400cbc62c696" returned: 0 in 0.244s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:11 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Lock "cinder-quobyte-4d9165ab-9da2-4dd5-a6ab-400cbc62c696" released by "_copy_volume_from_snapshot" :: held 5.865s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:11 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Acquiring lock "cinder-quobyte-8d70f8af-b552-4fd9-a95c-0a68a8867cab" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:11 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Lock "cinder-quobyte-8d70f8af-b552-4fd9-a95c-0a68a8867cab" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Deleting offline snapshot 8d70f8af-b552-4fd9-a95c-0a68a8867cab of volume e4a2f5d9-b305-43ac-a859-04a0d51e392d {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:19:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] snapshot_file for this snap is: volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:19:11 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e3b980-6353-4dbd-ac34-b5ba26ba227e]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:11 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab Jul 22 12:19:11 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:12 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab" returned: 0 in 0.395s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:19:12 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[917115a6-3253-4c4e-8975-35f0544d3772]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:12 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d Jul 22 12:19:12 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:12 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d" returned: 0 in 0.387s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:12 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab Jul 22 12:19:12 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:12 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab" returned: 0 in 0.325s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:12 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab Jul 22 12:19:12 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:13 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d.8d70f8af-b552-4fd9-a95c-0a68a8867cab" returned: 0 in 0.254s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Lock "cinder-quobyte-8d70f8af-b552-4fd9-a95c-0a68a8867cab" released by "_delete_snapshot" :: held 1.454s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.739s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.399s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-139503316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa761ad-3c04-4072-b1f5-7c415b2d56ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d049f95ddde4ba09b45711208c08bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:04Z,use_quota=True,user_id='632f3d946ce143c2ad87ebd720469102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Creating volume 5fa761ad-3c04-4072-b1f5-7c415b2d56ff {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:19:13 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (856e2965-a561-46d3-b075-e86bddeb3763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d9165ab-9da2-4dd5-a6ab-400cbc62c696', 'volume_size': 1, 'source_volid': 'e4a2f5d9-b305-43ac-a859-04a0d51e392d', 'source_volstatus': 'available'}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd16386-d395-4a04-9b2e-127889373d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:13 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff 1073741824 Jul 22 12:19:13 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:13 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Volume volume-4d9165ab-9da2-4dd5-a6ab-400cbc62c696 (4d9165ab-9da2-4dd5-a6ab-400cbc62c696): created successfully Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd16386-d395-4a04-9b2e-127889373d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Flow 'volume_create_manager' (a50619da-d44e-4a19-8ab5-863ad2efb41c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:13 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-020e9b35-0560-41ac-bd1f-8169c6a62710 tempest-VolumesGetTest-991120179 None] Created volume successfully. Jul 22 12:19:13 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff 1073741824" returned: 0 in 0.463s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:13 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff Jul 22 12:19:13 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:13 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff" returned: 0 in 0.238s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.453s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1814739760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048f7ce0-7514-4dde-915f-b004bf5ec8fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ecf6b24e8914283a5984e68bd9974a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:04Z,use_quota=True,user_id='6118441674a84cdfb684f2de2bb88231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Creating volume 048f7ce0-7514-4dde-915f-b004bf5ec8fb {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:19:14 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:19:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-048f7ce0-7514-4dde-915f-b004bf5ec8fb 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb475308-601e-46f8-a086-966d12e7a8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:14 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-048f7ce0-7514-4dde-915f-b004bf5ec8fb 1073741824 Jul 22 12:19:14 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4712d2f-73c1-4935-867c-0cd226e7faab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:14 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Volume volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff (5fa761ad-3c04-4072-b1f5-7c415b2d56ff): created successfully Jul 22 12:19:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4712d2f-73c1-4935-867c-0cd226e7faab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Flow 'volume_create_manager' (e1d70f02-7f69-45ff-8a18-ba54c40adb46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:14 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-66a7309c-d7a5-421d-afbc-29333efdb9f6 tempest-VolumesSnapshotTestJSON-493288019 None] Created volume successfully. Jul 22 12:19:14 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-048f7ce0-7514-4dde-915f-b004bf5ec8fb 1073741824" returned: 0 in 0.606s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-048f7ce0-7514-4dde-915f-b004bf5ec8fb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:14 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-048f7ce0-7514-4dde-915f-b004bf5ec8fb Jul 22 12:19:14 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:15 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-048f7ce0-7514-4dde-915f-b004bf5ec8fb" returned: 0 in 0.399s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a81d11b-581b-40b3-af71-dcf9c02321d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-048f7ce0-7514-4dde-915f-b004bf5ec8fb', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46087b2f-2782-4a89-bcec-c20adcc1d9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:15 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Volume volume-048f7ce0-7514-4dde-915f-b004bf5ec8fb (048f7ce0-7514-4dde-915f-b004bf5ec8fb): created successfully Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46087b2f-2782-4a89-bcec-c20adcc1d9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Flow 'volume_create_manager' (fa2a9ee5-4c57-485b-8e2f-1f576836d544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:15 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-1a68c670-118c-4512-9a50-9f56b4da8e96 tempest-VolumesTransfersTest-421194743 None] Created volume successfully. Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-466f2c16-77b1-4629-a52c-3e31fcb9080b tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-466f2c16-77b1-4629-a52c-3e31fcb9080b tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Flow 'volume_create_manager' (ea905418-e8be-4748-9154-45ec4618c105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b25d6dd-dbbf-4f0a-9dce-45256139f94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-466f2c16-77b1-4629-a52c-3e31fcb9080b tempest-VolumesSnapshotTestJSON-493288019 None] Creating offline snapshot 2ca197a7-869e-4ec2-a9b3-323bb08b15e9 of volume 5fa761ad-3c04-4072-b1f5-7c415b2d56ff {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b25d6dd-dbbf-4f0a-9dce-45256139f94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1327916335',display_name='tempest-VolumesGetTest-Volume-2084479872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1800df50-5ab5-4ad4-a575-e34ff5053787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18dbab1b06b413eaf97890d9bb678b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:15Z,use_quota=True,user_id='460053ab3ac546b7a2c813ccf557f9d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e7e364-899d-4474-83f3-a5e94671a4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e7e364-899d-4474-83f3-a5e94671a4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d215e8-3dfe-4c64-970c-7a0cdbe88d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d215e8-3dfe-4c64-970c-7a0cdbe88d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1800df50-5ab5-4ad4-a575-e34ff5053787', 'volume_name': 'volume-1800df50-5ab5-4ad4-a575-e34ff5053787', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14244053-a98a-4e34-b4cc-81d886045e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14244053-a98a-4e34-b4cc-81d886045e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36e6b08-647f-4caa-90c2-0d0b92ce341a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:15 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Volume 1800df50-5ab5-4ad4-a575-e34ff5053787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1800df50-5ab5-4ad4-a575-e34ff5053787', 'volume_size': 1} Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[763df71a-e21d-4931-8f02-2490ec2b3545]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-466f2c16-77b1-4629-a52c-3e31fcb9080b tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:15 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff Jul 22 12:19:15 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:15 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-466f2c16-77b1-4629-a52c-3e31fcb9080b tempest-VolumesSnapshotTestJSON-493288019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff" returned: 0 in 0.434s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-466f2c16-77b1-4629-a52c-3e31fcb9080b tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:15 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9 1G Jul 22 12:19:15 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:16 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-0420058c-0914-4c93-b33e-8939e350855b tempest-VolumesTransfersTest-424149562 None] Transfer volume completed successfully. Jul 22 12:19:16 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-466f2c16-77b1-4629-a52c-3e31fcb9080b tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9 1G" returned: 0 in 0.528s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-466f2c16-77b1-4629-a52c-3e31fcb9080b tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:16 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9 Jul 22 12:19:16 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5ae20b1-bf99-423e-9df6-f7869ea585e3 tempest-VolumesTransfersTest-851124297 None] Acquiring lock "cinder-048f7ce0-7514-4dde-915f-b004bf5ec8fb-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5ae20b1-bf99-423e-9df6-f7869ea585e3 tempest-VolumesTransfersTest-851124297 None] Lock "cinder-048f7ce0-7514-4dde-915f-b004bf5ec8fb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5ae20b1-bf99-423e-9df6-f7869ea585e3 tempest-VolumesTransfersTest-851124297 None] Acquiring lock "cinder-quobyte-048f7ce0-7514-4dde-915f-b004bf5ec8fb" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5ae20b1-bf99-423e-9df6-f7869ea585e3 tempest-VolumesTransfersTest-851124297 None] Lock "cinder-quobyte-048f7ce0-7514-4dde-915f-b004bf5ec8fb" acquired by "delete_volume" :: waited 0.015s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:16 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-466f2c16-77b1-4629-a52c-3e31fcb9080b tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9" returned: 0 in 0.386s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:16 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-466f2c16-77b1-4629-a52c-3e31fcb9080b tempest-VolumesSnapshotTestJSON-493288019 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9 is being set with open permissions: ugo+rw Jul 22 12:19:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-466f2c16-77b1-4629-a52c-3e31fcb9080b tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:16 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69797c8-14bc-49dd-8a13-4d115c22a629]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5ae20b1-bf99-423e-9df6-f7869ea585e3 tempest-VolumesTransfersTest-851124297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-048f7ce0-7514-4dde-915f-b004bf5ec8fb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:16 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9 Jul 22 12:19:16 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:16 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-048f7ce0-7514-4dde-915f-b004bf5ec8fb Jul 22 12:19:16 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:17 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-466f2c16-77b1-4629-a52c-3e31fcb9080b tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9" returned: 0 in 0.344s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-466f2c16-77b1-4629-a52c-3e31fcb9080b tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:17 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.info Jul 22 12:19:17 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:17 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5ae20b1-bf99-423e-9df6-f7869ea585e3 tempest-VolumesTransfersTest-851124297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-048f7ce0-7514-4dde-915f-b004bf5ec8fb" returned: 0 in 0.546s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5ae20b1-bf99-423e-9df6-f7869ea585e3 tempest-VolumesTransfersTest-851124297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-048f7ce0-7514-4dde-915f-b004bf5ec8fb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:17 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-048f7ce0-7514-4dde-915f-b004bf5ec8fb Jul 22 12:19:17 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:17 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-466f2c16-77b1-4629-a52c-3e31fcb9080b tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.info" returned: 0 in 0.459s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:17 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-466f2c16-77b1-4629-a52c-3e31fcb9080b tempest-VolumesSnapshotTestJSON-493288019 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.info is being set with open permissions: ugo+rw Jul 22 12:19:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-466f2c16-77b1-4629-a52c-3e31fcb9080b tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:17 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.info Jul 22 12:19:17 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:17 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5ae20b1-bf99-423e-9df6-f7869ea585e3 tempest-VolumesTransfersTest-851124297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-048f7ce0-7514-4dde-915f-b004bf5ec8fb" returned: 0 in 0.341s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:17 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5ae20b1-bf99-423e-9df6-f7869ea585e3 tempest-VolumesTransfersTest-851124297 None] Lock "cinder-quobyte-048f7ce0-7514-4dde-915f-b004bf5ec8fb" released by "delete_volume" :: held 0.974s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:17 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-816f89fa-a520-4e22-9a2a-54465337bb1f req-f1ef9f4c-866d-4ca7-9e56-0ab365a2b845 tempest-TestShelveInstance-1552906758 None] Terminate volume connection completed successfully. Jul 22 12:19:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-816f89fa-a520-4e22-9a2a-54465337bb1f req-f1ef9f4c-866d-4ca7-9e56-0ab365a2b845 tempest-TestShelveInstance-1552906758 None] Deleting attachment e6e6af74-16c3-4fbe-8af0-d5fe7dde46a7. {{(pid=87568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 12:19:17 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-d5ae20b1-bf99-423e-9df6-f7869ea585e3 tempest-VolumesTransfersTest-851124297 None] Created reservations ['1a34bf26-6208-4682-888d-467b1fc79425', 'e961d2cf-aebd-4d10-8021-c73b817c43fa', 'e4c5ac82-f77c-4551-bacd-fee17c983089', '383db5b6-3739-4443-9593-a9678a842d37'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:19:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d5ae20b1-bf99-423e-9df6-f7869ea585e3 tempest-VolumesTransfersTest-851124297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d5ae20b1-bf99-423e-9df6-f7869ea585e3 tempest-VolumesTransfersTest-851124297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d5ae20b1-bf99-423e-9df6-f7869ea585e3 tempest-VolumesTransfersTest-851124297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d5ae20b1-bf99-423e-9df6-f7869ea585e3 tempest-VolumesTransfersTest-851124297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d5ae20b1-bf99-423e-9df6-f7869ea585e3 tempest-VolumesTransfersTest-851124297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5ae20b1-bf99-423e-9df6-f7869ea585e3 tempest-VolumesTransfersTest-851124297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:17 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-466f2c16-77b1-4629-a52c-3e31fcb9080b tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.info" returned: 0 in 0.285s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:17 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:19:17 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-466f2c16-77b1-4629-a52c-3e31fcb9080b tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.696s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.553s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1327916335',display_name='tempest-VolumesGetTest-Volume-2084479872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1800df50-5ab5-4ad4-a575-e34ff5053787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18dbab1b06b413eaf97890d9bb678b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:15Z,use_quota=True,user_id='460053ab3ac546b7a2c813ccf557f9d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:19:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Creating volume 1800df50-5ab5-4ad4-a575-e34ff5053787 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:19:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:19:18 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:19:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1800df50-5ab5-4ad4-a575-e34ff5053787 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:18 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1800df50-5ab5-4ad4-a575-e34ff5053787 1073741824 Jul 22 12:19:18 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:18 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-466f2c16-77b1-4629-a52c-3e31fcb9080b tempest-VolumesSnapshotTestJSON-493288019 None] Create snapshot completed successfully Jul 22 12:19:18 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5ae20b1-bf99-423e-9df6-f7869ea585e3 tempest-VolumesTransfersTest-851124297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.528s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:18 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-d5ae20b1-bf99-423e-9df6-f7869ea585e3 tempest-VolumesTransfersTest-851124297 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:19:18 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d5ae20b1-bf99-423e-9df6-f7869ea585e3 tempest-VolumesTransfersTest-851124297 None] Deleted volume successfully. Jul 22 12:19:18 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5ae20b1-bf99-423e-9df6-f7869ea585e3 tempest-VolumesTransfersTest-851124297 None] Lock "cinder-048f7ce0-7514-4dde-915f-b004bf5ec8fb-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:18 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1800df50-5ab5-4ad4-a575-e34ff5053787 1073741824" returned: 0 in 0.676s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1800df50-5ab5-4ad4-a575-e34ff5053787 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:18 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1800df50-5ab5-4ad4-a575-e34ff5053787 Jul 22 12:19:18 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:18 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:19:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Flow 'volume_create_manager' (210852a9-cda5-42b8-b46b-085ec17029d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a2c790-88b9-477a-a924-b287a11ade3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a2c790-88b9-477a-a924-b287a11ade3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1763739234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a206b7-c20c-47de-a79b-30d05d22e8a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d049f95ddde4ba09b45711208c08bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2ca197a7-869e-4ec2-a9b3-323bb08b15e9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:19Z,use_quota=True,user_id='632f3d946ce143c2ad87ebd720469102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987ad0c9-15ab-42da-ab54-5850ba7b181e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987ad0c9-15ab-42da-ab54-5850ba7b181e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a059a91-77e1-4fe6-be01-6251bd17f151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a059a91-77e1-4fe6-be01-6251bd17f151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '89a206b7-c20c-47de-a79b-30d05d22e8a7', 'volume_name': 'volume-89a206b7-c20c-47de-a79b-30d05d22e8a7', 'volume_size': 1, 'snapshot_id': '2ca197a7-869e-4ec2-a9b3-323bb08b15e9'}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde16324-d241-49a6-b14d-555d578eb240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde16324-d241-49a6-b14d-555d578eb240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f403f7cf-152a-45c5-9eab-35b5b1f408e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:19 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Volume 89a206b7-c20c-47de-a79b-30d05d22e8a7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-89a206b7-c20c-47de-a79b-30d05d22e8a7', 'volume_size': 1, 'snapshot_id': '2ca197a7-869e-4ec2-a9b3-323bb08b15e9'} Jul 22 12:19:19 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1800df50-5ab5-4ad4-a575-e34ff5053787" returned: 0 in 0.304s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-quobyte-2ca197a7-869e-4ec2-a9b3-323bb08b15e9-89a206b7-c20c-47de-a79b-30d05d22e8a7" by "_create_volume_from_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36e6b08-647f-4caa-90c2-0d0b92ce341a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1800df50-5ab5-4ad4-a575-e34ff5053787', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (169584ae-e670-4bd4-804d-bea73d0e3d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-2ca197a7-869e-4ec2-a9b3-323bb08b15e9-89a206b7-c20c-47de-a79b-30d05d22e8a7" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Creating volume 89a206b7-c20c-47de-a79b-30d05d22e8a7 from snapshot 2ca197a7-869e-4ec2-a9b3-323bb08b15e9 {{(pid=87568) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-quobyte-89a206b7-c20c-47de-a79b-30d05d22e8a7" by "_copy_volume_from_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:19 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Volume volume-1800df50-5ab5-4ad4-a575-e34ff5053787 (1800df50-5ab5-4ad4-a575-e34ff5053787): created successfully Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (169584ae-e670-4bd4-804d-bea73d0e3d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Flow 'volume_create_manager' (ea905418-e8be-4748-9154-45ec4618c105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-89a206b7-c20c-47de-a79b-30d05d22e8a7" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] snapshot: 2ca197a7-869e-4ec2-a9b3-323bb08b15e9, volume: 89a206b7-c20c-47de-a79b-30d05d22e8a7, {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 12:19:19 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-1577255e-8f7d-45b9-ac16-7dd24b956776 tempest-VolumesGetTest-991120179 None] Created volume successfully. Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[10832625-d923-4c32-aaec-8bcdc9c3ee59]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:19 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9 Jul 22 12:19:19 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Flow 'volume_create_manager' (43f54bd6-e6cb-46d1-8b91-7c514c0fe595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (847e5204-1e72-43ef-9c01-d64fcb34b4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (847e5204-1e72-43ef-9c01-d64fcb34b4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-793317115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e810ca84-df2f-446a-b03f-a6900635c02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ecf6b24e8914283a5984e68bd9974a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:19Z,use_quota=True,user_id='6118441674a84cdfb684f2de2bb88231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68df8f38-d206-486a-97e9-84492f1038fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68df8f38-d206-486a-97e9-84492f1038fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948b000b-ce14-4ad6-a8c1-8b4b684d74a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948b000b-ce14-4ad6-a8c1-8b4b684d74a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e810ca84-df2f-446a-b03f-a6900635c02b', 'volume_name': 'volume-e810ca84-df2f-446a-b03f-a6900635c02b', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a584f7b-42f0-4fec-9b26-fc23faa7ef0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a584f7b-42f0-4fec-9b26-fc23faa7ef0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f96bfa-ad31-45ea-9b82-9ad226c95114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:19 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Volume e810ca84-df2f-446a-b03f-a6900635c02b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e810ca84-df2f-446a-b03f-a6900635c02b', 'volume_size': 1} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7de1d119-b4c8-4fe1-ad42-f0489c62a11a tempest-VolumesGetTest-991120179 None] Acquiring lock "cinder-1800df50-5ab5-4ad4-a575-e34ff5053787-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:19 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9" returned: 0 in 0.443s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] will copy from snapshot at /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Creating direct copy from snapshot {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7de1d119-b4c8-4fe1-ad42-f0489c62a11a tempest-VolumesGetTest-991120179 None] Lock "cinder-1800df50-5ab5-4ad4-a575-e34ff5053787-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[067dd172-5023-4aef-b241-887996d48b44]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7de1d119-b4c8-4fe1-ad42-f0489c62a11a tempest-VolumesGetTest-991120179 None] Acquiring lock "cinder-quobyte-1800df50-5ab5-4ad4-a575-e34ff5053787" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7de1d119-b4c8-4fe1-ad42-f0489c62a11a tempest-VolumesGetTest-991120179 None] Lock "cinder-quobyte-1800df50-5ab5-4ad4-a575-e34ff5053787" acquired by "delete_volume" :: waited 0.022s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[337a464f-d81e-493a-92d3-e2d03d11dcfd]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7de1d119-b4c8-4fe1-ad42-f0489c62a11a tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1800df50-5ab5-4ad4-a575-e34ff5053787 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:19 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff Jul 22 12:19:19 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:19 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1800df50-5ab5-4ad4-a575-e34ff5053787 Jul 22 12:19:19 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:20 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff" returned: 0 in 0.418s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:20 devstack cinder-volume[87568]: DEBUG cinder.utils [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Path /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-89a206b7-c20c-47de-a79b-30d05d22e8a7 not found in is_blk_device check {{(pid=87568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 12:19:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-89a206b7-c20c-47de-a79b-30d05d22e8a7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:20 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-89a206b7-c20c-47de-a79b-30d05d22e8a7 Jul 22 12:19:20 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:20 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7de1d119-b4c8-4fe1-ad42-f0489c62a11a tempest-VolumesGetTest-991120179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1800df50-5ab5-4ad4-a575-e34ff5053787" returned: 0 in 0.419s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7de1d119-b4c8-4fe1-ad42-f0489c62a11a tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1800df50-5ab5-4ad4-a575-e34ff5053787 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:20 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1800df50-5ab5-4ad4-a575-e34ff5053787 Jul 22 12:19:20 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:20 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7de1d119-b4c8-4fe1-ad42-f0489c62a11a tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1800df50-5ab5-4ad4-a575-e34ff5053787" returned: 0 in 0.264s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7de1d119-b4c8-4fe1-ad42-f0489c62a11a tempest-VolumesGetTest-991120179 None] Lock "cinder-quobyte-1800df50-5ab5-4ad4-a575-e34ff5053787" released by "delete_volume" :: held 0.723s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:20 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-7de1d119-b4c8-4fe1-ad42-f0489c62a11a tempest-VolumesGetTest-991120179 None] Created reservations ['71fe540a-326a-4917-8b77-1404889ecce8', 'c0ef80cc-9a9c-41d3-a3e0-8bc454f469b8', '30d3d575-415b-4f6a-80e9-753feac53e71', 'ea68d040-8865-4e12-94a9-29a450946f27'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:19:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7de1d119-b4c8-4fe1-ad42-f0489c62a11a tempest-VolumesGetTest-991120179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7de1d119-b4c8-4fe1-ad42-f0489c62a11a tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:20 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7de1d119-b4c8-4fe1-ad42-f0489c62a11a tempest-VolumesGetTest-991120179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:20 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7de1d119-b4c8-4fe1-ad42-f0489c62a11a tempest-VolumesGetTest-991120179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7de1d119-b4c8-4fe1-ad42-f0489c62a11a tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7de1d119-b4c8-4fe1-ad42-f0489c62a11a tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:20 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:19:20 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:21 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7de1d119-b4c8-4fe1-ad42-f0489c62a11a tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.608s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:21 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-7de1d119-b4c8-4fe1-ad42-f0489c62a11a tempest-VolumesGetTest-991120179 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:19:21 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-7de1d119-b4c8-4fe1-ad42-f0489c62a11a tempest-VolumesGetTest-991120179 None] Deleted volume successfully. Jul 22 12:19:21 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-715489ef-35f6-4bf0-9253-ac75ce2e00c4 tempest-VolumesGetTest-991120179 None] Acquiring lock "cinder-4d9165ab-9da2-4dd5-a6ab-400cbc62c696-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:21 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-715489ef-35f6-4bf0-9253-ac75ce2e00c4 tempest-VolumesGetTest-991120179 None] Lock "cinder-4d9165ab-9da2-4dd5-a6ab-400cbc62c696-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:21 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7de1d119-b4c8-4fe1-ad42-f0489c62a11a tempest-VolumesGetTest-991120179 None] Lock "cinder-1800df50-5ab5-4ad4-a575-e34ff5053787-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:21 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-715489ef-35f6-4bf0-9253-ac75ce2e00c4 tempest-VolumesGetTest-991120179 None] Acquiring lock "cinder-quobyte-4d9165ab-9da2-4dd5-a6ab-400cbc62c696" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:21 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-715489ef-35f6-4bf0-9253-ac75ce2e00c4 tempest-VolumesGetTest-991120179 None] Lock "cinder-quobyte-4d9165ab-9da2-4dd5-a6ab-400cbc62c696" acquired by "delete_volume" :: waited 0.054s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:21 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a384b4c8-cb6d-4c8e-82f5-f8c24ba04f68]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-715489ef-35f6-4bf0-9253-ac75ce2e00c4 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d9165ab-9da2-4dd5-a6ab-400cbc62c696 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:21 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d9165ab-9da2-4dd5-a6ab-400cbc62c696 Jul 22 12:19:21 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:22 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-715489ef-35f6-4bf0-9253-ac75ce2e00c4 tempest-VolumesGetTest-991120179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d9165ab-9da2-4dd5-a6ab-400cbc62c696" returned: 0 in 0.851s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-715489ef-35f6-4bf0-9253-ac75ce2e00c4 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d9165ab-9da2-4dd5-a6ab-400cbc62c696 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:22 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d9165ab-9da2-4dd5-a6ab-400cbc62c696 Jul 22 12:19:22 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-7a58514e-5622-4513-9a02-4c6f7d8bbfb6 req-cde9a4e9-7d0d-4245-bfae-07c7d1f51382 tempest-TestShelveInstance-1552906758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:23 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-715489ef-35f6-4bf0-9253-ac75ce2e00c4 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d9165ab-9da2-4dd5-a6ab-400cbc62c696" returned: 0 in 0.587s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-715489ef-35f6-4bf0-9253-ac75ce2e00c4 tempest-VolumesGetTest-991120179 None] Lock "cinder-quobyte-4d9165ab-9da2-4dd5-a6ab-400cbc62c696" released by "delete_volume" :: held 1.596s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:23 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-715489ef-35f6-4bf0-9253-ac75ce2e00c4 tempest-VolumesGetTest-991120179 None] Created reservations ['129009fd-a8ea-4983-8838-b72c1c424991', 'addc7c8e-a096-418c-935e-b414a44d096d', 'f9384fcc-34d8-433f-8b5d-37e669020c11', 'df5e4240-bcf5-4f43-9a89-b3fdea4b602f'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:19:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-715489ef-35f6-4bf0-9253-ac75ce2e00c4 tempest-VolumesGetTest-991120179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-715489ef-35f6-4bf0-9253-ac75ce2e00c4 tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-715489ef-35f6-4bf0-9253-ac75ce2e00c4 tempest-VolumesGetTest-991120179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-715489ef-35f6-4bf0-9253-ac75ce2e00c4 tempest-VolumesGetTest-991120179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-715489ef-35f6-4bf0-9253-ac75ce2e00c4 tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-715489ef-35f6-4bf0-9253-ac75ce2e00c4 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:23 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:19:23 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:24 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-715489ef-35f6-4bf0-9253-ac75ce2e00c4 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.585s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:24 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-715489ef-35f6-4bf0-9253-ac75ce2e00c4 tempest-VolumesGetTest-991120179 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:19:24 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-715489ef-35f6-4bf0-9253-ac75ce2e00c4 tempest-VolumesGetTest-991120179 None] Deleted volume successfully. Jul 22 12:19:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-68a8b455-2ee6-49aa-bee7-0459a6bcd375 tempest-VolumesGetTest-991120179 None] Acquiring lock "cinder-e4a2f5d9-b305-43ac-a859-04a0d51e392d-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-715489ef-35f6-4bf0-9253-ac75ce2e00c4 tempest-VolumesGetTest-991120179 None] Lock "cinder-4d9165ab-9da2-4dd5-a6ab-400cbc62c696-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-68a8b455-2ee6-49aa-bee7-0459a6bcd375 tempest-VolumesGetTest-991120179 None] Lock "cinder-e4a2f5d9-b305-43ac-a859-04a0d51e392d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-68a8b455-2ee6-49aa-bee7-0459a6bcd375 tempest-VolumesGetTest-991120179 None] Acquiring lock "cinder-quobyte-e4a2f5d9-b305-43ac-a859-04a0d51e392d" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-68a8b455-2ee6-49aa-bee7-0459a6bcd375 tempest-VolumesGetTest-991120179 None] Lock "cinder-quobyte-e4a2f5d9-b305-43ac-a859-04a0d51e392d" acquired by "delete_volume" :: waited 0.027s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:24 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8342f57-dbe3-4645-accd-b67f0c005cc5]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:19:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-68a8b455-2ee6-49aa-bee7-0459a6bcd375 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:24 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:19:24 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:24 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d Jul 22 12:19:24 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:24 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.486s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:24 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:19:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:19:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread count: 28 {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:19:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread info: [<_MainThread(MainThread, started 137793405739136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:19:25 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-68a8b455-2ee6-49aa-bee7-0459a6bcd375 tempest-VolumesGetTest-991120179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d" returned: 0 in 0.848s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-68a8b455-2ee6-49aa-bee7-0459a6bcd375 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:25 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d Jul 22 12:19:25 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:25 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-68a8b455-2ee6-49aa-bee7-0459a6bcd375 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4a2f5d9-b305-43ac-a859-04a0d51e392d" returned: 0 in 0.513s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:25 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-89a206b7-c20c-47de-a79b-30d05d22e8a7" returned: 0 in 5.772s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:25 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-68a8b455-2ee6-49aa-bee7-0459a6bcd375 tempest-VolumesGetTest-991120179 None] Lock "cinder-quobyte-e4a2f5d9-b305-43ac-a859-04a0d51e392d" released by "delete_volume" :: held 1.565s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:25 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba95b186-19ee-41f4-a846-7ac0f7e258aa]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:25 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-68a8b455-2ee6-49aa-bee7-0459a6bcd375 tempest-VolumesGetTest-991120179 None] Created reservations ['8e0f9d77-9157-4430-bdcf-e1a7479a8742', 'ae04347c-e8a7-4a3e-adf0-77486c0f11dc', '17180cfb-cbe7-4029-8019-0df59c2e977a', 'fb4eb031-7b90-48ec-b05d-b7c759a9af14'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:19:25 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff Jul 22 12:19:25 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-68a8b455-2ee6-49aa-bee7-0459a6bcd375 tempest-VolumesGetTest-991120179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-68a8b455-2ee6-49aa-bee7-0459a6bcd375 tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-68a8b455-2ee6-49aa-bee7-0459a6bcd375 tempest-VolumesGetTest-991120179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-68a8b455-2ee6-49aa-bee7-0459a6bcd375 tempest-VolumesGetTest-991120179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-68a8b455-2ee6-49aa-bee7-0459a6bcd375 tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-68a8b455-2ee6-49aa-bee7-0459a6bcd375 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:26 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:19:26 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:26 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-68a8b455-2ee6-49aa-bee7-0459a6bcd375 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.252s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-68a8b455-2ee6-49aa-bee7-0459a6bcd375 tempest-VolumesGetTest-991120179 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:19:26 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-68a8b455-2ee6-49aa-bee7-0459a6bcd375 tempest-VolumesGetTest-991120179 None] Deleted volume successfully. Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-68a8b455-2ee6-49aa-bee7-0459a6bcd375 tempest-VolumesGetTest-991120179 None] Lock "cinder-e4a2f5d9-b305-43ac-a859-04a0d51e392d-delete_volume" released by "delete_volume" :: held 2.081s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:26 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff" returned: 0 in 0.550s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Image conversion details: src /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-89a206b7-c20c-47de-a79b-30d05d22e8a7 {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:19:26 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Converted 1024.00 MB image at 177.38 MB/s Jul 22 12:19:26 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-89a206b7-c20c-47de-a79b-30d05d22e8a7 is being set with open permissions: ugo+rw Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-89a206b7-c20c-47de-a79b-30d05d22e8a7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:26 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-89a206b7-c20c-47de-a79b-30d05d22e8a7 Jul 22 12:19:26 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:26 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-89a206b7-c20c-47de-a79b-30d05d22e8a7" returned: 0 in 0.250s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-89a206b7-c20c-47de-a79b-30d05d22e8a7" released by "_copy_volume_from_snapshot" :: held 7.547s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-2ca197a7-869e-4ec2-a9b3-323bb08b15e9-89a206b7-c20c-47de-a79b-30d05d22e8a7" released by "_create_volume_from_snapshot" :: held 7.591s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.622s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.075s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-793317115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e810ca84-df2f-446a-b03f-a6900635c02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ecf6b24e8914283a5984e68bd9974a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:19Z,use_quota=True,user_id='6118441674a84cdfb684f2de2bb88231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Creating volume e810ca84-df2f-446a-b03f-a6900635c02b {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:19:26 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e810ca84-df2f-446a-b03f-a6900635c02b 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:26 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e810ca84-df2f-446a-b03f-a6900635c02b 1073741824 Jul 22 12:19:26 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f403f7cf-152a-45c5-9eab-35b5b1f408e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a206b7-c20c-47de-a79b-30d05d22e8a7', 'volume_size': 1, 'snapshot_id': '2ca197a7-869e-4ec2-a9b3-323bb08b15e9'}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11550889-9c01-49ce-badb-b20e91ad905a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:26 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Volume volume-89a206b7-c20c-47de-a79b-30d05d22e8a7 (89a206b7-c20c-47de-a79b-30d05d22e8a7): created successfully Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11550889-9c01-49ce-badb-b20e91ad905a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Flow 'volume_create_manager' (210852a9-cda5-42b8-b46b-085ec17029d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:26 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-0f8ff6b6-b17f-4a08-b89b-031300a56ac9 tempest-VolumesSnapshotTestJSON-493288019 None] Created volume successfully. Jul 22 12:19:27 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e810ca84-df2f-446a-b03f-a6900635c02b 1073741824" returned: 0 in 0.450s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e810ca84-df2f-446a-b03f-a6900635c02b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:27 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e810ca84-df2f-446a-b03f-a6900635c02b Jul 22 12:19:27 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Flow 'volume_create_manager' (fc1b9db0-e75b-4e5f-b22c-73c6b7537e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e6eea1-b087-49d8-ac1a-20f2fe7a4328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e6eea1-b087-49d8-ac1a-20f2fe7a4328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1513361429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c640bf6-06ab-49ec-8960-56da63394052,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f18dbab1b06b413eaf97890d9bb678b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:27Z,use_quota=True,user_id='460053ab3ac546b7a2c813ccf557f9d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0df75f0-bb91-4125-9f5f-3f05ea7fa428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0df75f0-bb91-4125-9f5f-3f05ea7fa428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a591cb41-defc-4fd2-8ec2-baa788acc10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.image.glance [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Creating Keystone auth plugin from conf {{(pid=87568) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1ff56afe-e8ec-4038-bf0d-db30cfb6f8ca tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-89a206b7-c20c-47de-a79b-30d05d22e8a7-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1ff56afe-e8ec-4038-bf0d-db30cfb6f8ca tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-89a206b7-c20c-47de-a79b-30d05d22e8a7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1ff56afe-e8ec-4038-bf0d-db30cfb6f8ca tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-quobyte-89a206b7-c20c-47de-a79b-30d05d22e8a7" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:27 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e810ca84-df2f-446a-b03f-a6900635c02b" returned: 0 in 0.280s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-7a58514e-5622-4513-9a02-4c6f7d8bbfb6 req-cde9a4e9-7d0d-4245-bfae-07c7d1f51382 tempest-TestShelveInstance-1552906758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.611s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1ff56afe-e8ec-4038-bf0d-db30cfb6f8ca tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-89a206b7-c20c-47de-a79b-30d05d22e8a7" acquired by "delete_volume" :: waited 0.031s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f96bfa-ad31-45ea-9b82-9ad226c95114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e810ca84-df2f-446a-b03f-a6900635c02b', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5065d26c-5519-488b-ab3d-fee9ab97a0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-7a58514e-5622-4513-9a02-4c6f7d8bbfb6 req-cde9a4e9-7d0d-4245-bfae-07c7d1f51382 tempest-TestShelveInstance-1552906758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a04fe29-4a82-4c2c-b285-21f755178b8d]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1ff56afe-e8ec-4038-bf0d-db30cfb6f8ca tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-89a206b7-c20c-47de-a79b-30d05d22e8a7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:27 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Volume volume-e810ca84-df2f-446a-b03f-a6900635c02b (e810ca84-df2f-446a-b03f-a6900635c02b): created successfully Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5065d26c-5519-488b-ab3d-fee9ab97a0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Flow 'volume_create_manager' (43f54bd6-e6cb-46d1-8b91-7c514c0fe595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:27 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e8ca2c8a-91ec-4ce2-9238-b76b686b2e08 tempest-VolumesTransfersTest-421194743 None] Created volume successfully. Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-7a58514e-5622-4513-9a02-4c6f7d8bbfb6 req-cde9a4e9-7d0d-4245-bfae-07c7d1f51382 tempest-TestShelveInstance-1552906758 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29', 'name': 'volume-1b262626-0dbe-4fb5-853e-06bac1abac7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8913388e-053a-4f46-82ff-51f8531b90ce', 'enforce_multipath': True} {{(pid=87568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 12:19:27 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-89a206b7-c20c-47de-a79b-30d05d22e8a7 Jul 22 12:19:27 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:27 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-7a58514e-5622-4513-9a02-4c6f7d8bbfb6 req-cde9a4e9-7d0d-4245-bfae-07c7d1f51382 tempest-TestShelveInstance-1552906758 None] attachment_update completed successfully. Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a591cb41-defc-4fd2-8ec2-baa788acc10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4c640bf6-06ab-49ec-8960-56da63394052', 'volume_name': 'volume-4c640bf6-06ab-49ec-8960-56da63394052', 'volume_size': 1, 'image_id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fe02ba8749e04b7eaeb23823f684fdc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'created_at': datetime.datetime(2026, 7, 22, 10, 2, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 2, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355bdc5b-7b04-4809-8b68-fc5ab338431a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355bdc5b-7b04-4809-8b68-fc5ab338431a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a64017-421b-431f-9e38-395f69626657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:27 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Volume 4c640bf6-06ab-49ec-8960-56da63394052: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4c640bf6-06ab-49ec-8960-56da63394052', 'volume_size': 1, 'image_id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fe02ba8749e04b7eaeb23823f684fdc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'created_at': datetime.datetime(2026, 7, 22, 10, 2, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 2, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Trying to clone 4c640bf6-06ab-49ec-8960-56da63394052 from image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e at location (None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}]). {{(pid=87568) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 12:19:27 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1ff56afe-e8ec-4038-bf0d-db30cfb6f8ca tempest-VolumesSnapshotTestJSON-493288019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-89a206b7-c20c-47de-a79b-30d05d22e8a7" returned: 0 in 0.439s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1ff56afe-e8ec-4038-bf0d-db30cfb6f8ca tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-89a206b7-c20c-47de-a79b-30d05d22e8a7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:28 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-89a206b7-c20c-47de-a79b-30d05d22e8a7 Jul 22 12:19:28 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5ky1pfgsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 12:19:28 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Image download 20.69 MB at 20.69 MB/s Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f554809c-0730-428a-9715-905b6b525f44]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5ky1pfgsdevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:28 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1ff56afe-e8ec-4038-bf0d-db30cfb6f8ca tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-89a206b7-c20c-47de-a79b-30d05d22e8a7" returned: 0 in 0.415s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1ff56afe-e8ec-4038-bf0d-db30cfb6f8ca tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-89a206b7-c20c-47de-a79b-30d05d22e8a7" released by "delete_volume" :: held 0.911s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:28 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5ky1pfgsdevstack@QuobyteHD Jul 22 12:19:28 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-1ff56afe-e8ec-4038-bf0d-db30cfb6f8ca tempest-VolumesSnapshotTestJSON-493288019 None] Created reservations ['6b877b31-d687-40a7-a4fb-f36b7695eae9', '59f8c5e5-a818-4c4f-b1bd-58c14191198a', 'd33772f7-a4ed-4956-98fa-433a68210524', '72582297-701a-48a4-a4ec-bf49a592dcb5'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1ff56afe-e8ec-4038-bf0d-db30cfb6f8ca tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1ff56afe-e8ec-4038-bf0d-db30cfb6f8ca tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1ff56afe-e8ec-4038-bf0d-db30cfb6f8ca tempest-VolumesSnapshotTestJSON-493288019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1ff56afe-e8ec-4038-bf0d-db30cfb6f8ca tempest-VolumesSnapshotTestJSON-493288019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1ff56afe-e8ec-4038-bf0d-db30cfb6f8ca tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1ff56afe-e8ec-4038-bf0d-db30cfb6f8ca tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:28 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:19:28 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-52f69649-f459-4e88-94bf-baca50edec7b tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-2ca197a7-869e-4ec2-a9b3-323bb08b15e9-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-52f69649-f459-4e88-94bf-baca50edec7b tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-2ca197a7-869e-4ec2-a9b3-323bb08b15e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-52f69649-f459-4e88-94bf-baca50edec7b tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-quobyte-5fa761ad-3c04-4072-b1f5-7c415b2d56ff" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-52f69649-f459-4e88-94bf-baca50edec7b tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-5fa761ad-3c04-4072-b1f5-7c415b2d56ff" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-52f69649-f459-4e88-94bf-baca50edec7b tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-quobyte-2ca197a7-869e-4ec2-a9b3-323bb08b15e9" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:28 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5ky1pfgsdevstack@QuobyteHD" returned: 0 in 0.584s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Temporary image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e is fetched for user 460053ab3ac546b7a2c813ccf557f9d8. {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-52f69649-f459-4e88-94bf-baca50edec7b tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-2ca197a7-869e-4ec2-a9b3-323bb08b15e9" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-52f69649-f459-4e88-94bf-baca50edec7b tempest-VolumesSnapshotTestJSON-493288019 None] Deleting offline snapshot 2ca197a7-869e-4ec2-a9b3-323bb08b15e9 of volume 5fa761ad-3c04-4072-b1f5-7c415b2d56ff {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-52f69649-f459-4e88-94bf-baca50edec7b tempest-VolumesSnapshotTestJSON-493288019 None] snapshot_file for this snap is: volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-eeadbe91-78f4-4b42-9db6-5725b74748bb tempest-VolumesTransfersTest-851124297 None] Acquiring lock "cinder-e810ca84-df2f-446a-b03f-a6900635c02b-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[647fe640-0f40-4ed1-bc0a-016eea96721f]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-52f69649-f459-4e88-94bf-baca50edec7b tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-eeadbe91-78f4-4b42-9db6-5725b74748bb tempest-VolumesTransfersTest-851124297 None] Lock "cinder-e810ca84-df2f-446a-b03f-a6900635c02b-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0b5854-6dbd-40f4-b9fa-513474535ca2]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5ky1pfgsdevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:29 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-eeadbe91-78f4-4b42-9db6-5725b74748bb tempest-VolumesTransfersTest-851124297 None] Acquiring lock "cinder-quobyte-e810ca84-df2f-446a-b03f-a6900635c02b" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1ff56afe-e8ec-4038-bf0d-db30cfb6f8ca tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.440s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-1ff56afe-e8ec-4038-bf0d-db30cfb6f8ca tempest-VolumesSnapshotTestJSON-493288019 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:19:29 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-1ff56afe-e8ec-4038-bf0d-db30cfb6f8ca tempest-VolumesSnapshotTestJSON-493288019 None] Deleted volume successfully. Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-eeadbe91-78f4-4b42-9db6-5725b74748bb tempest-VolumesTransfersTest-851124297 None] Lock "cinder-quobyte-e810ca84-df2f-446a-b03f-a6900635c02b" acquired by "delete_volume" :: waited 0.040s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1ff56afe-e8ec-4038-bf0d-db30cfb6f8ca tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-89a206b7-c20c-47de-a79b-30d05d22e8a7-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6020ab30-64fb-4c2f-8685-225be66a53f7]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eeadbe91-78f4-4b42-9db6-5725b74748bb tempest-VolumesTransfersTest-851124297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e810ca84-df2f-446a-b03f-a6900635c02b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:29 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9 Jul 22 12:19:29 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:29 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5ky1pfgsdevstack@QuobyteHD Jul 22 12:19:29 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:29 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e810ca84-df2f-446a-b03f-a6900635c02b Jul 22 12:19:29 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:29 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5ky1pfgsdevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:29 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1513361429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c640bf6-06ab-49ec-8960-56da63394052,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f18dbab1b06b413eaf97890d9bb678b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:27Z,use_quota=True,user_id='460053ab3ac546b7a2c813ccf557f9d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Creating volume 4c640bf6-06ab-49ec-8960-56da63394052 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:19:29 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4c640bf6-06ab-49ec-8960-56da63394052 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-52f69649-f459-4e88-94bf-baca50edec7b tempest-VolumesSnapshotTestJSON-493288019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9" returned: 0 in 0.613s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-52f69649-f459-4e88-94bf-baca50edec7b tempest-VolumesSnapshotTestJSON-493288019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:19:29 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4c640bf6-06ab-49ec-8960-56da63394052 1073741824 Jul 22 12:19:29 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5231d3-5bd9-4252-90e6-faae0e29971e]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-52f69649-f459-4e88-94bf-baca50edec7b tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:29 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:29 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eeadbe91-78f4-4b42-9db6-5725b74748bb tempest-VolumesTransfersTest-851124297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e810ca84-df2f-446a-b03f-a6900635c02b" returned: 0 in 0.597s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:29 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eeadbe91-78f4-4b42-9db6-5725b74748bb tempest-VolumesTransfersTest-851124297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e810ca84-df2f-446a-b03f-a6900635c02b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:29 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e810ca84-df2f-446a-b03f-a6900635c02b Jul 22 12:19:29 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:30 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4c640bf6-06ab-49ec-8960-56da63394052 1073741824" returned: 0 in 0.519s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:30 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-52f69649-f459-4e88-94bf-baca50edec7b tempest-VolumesSnapshotTestJSON-493288019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff" returned: 0 in 0.480s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-52f69649-f459-4e88-94bf-baca50edec7b tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:30 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eeadbe91-78f4-4b42-9db6-5725b74748bb tempest-VolumesTransfersTest-851124297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e810ca84-df2f-446a-b03f-a6900635c02b" returned: 0 in 0.372s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:30 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9 Jul 22 12:19:30 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-eeadbe91-78f4-4b42-9db6-5725b74748bb tempest-VolumesTransfersTest-851124297 None] Lock "cinder-quobyte-e810ca84-df2f-446a-b03f-a6900635c02b" released by "delete_volume" :: held 1.034s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4c640bf6-06ab-49ec-8960-56da63394052 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:30 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4c640bf6-06ab-49ec-8960-56da63394052 Jul 22 12:19:30 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-eeadbe91-78f4-4b42-9db6-5725b74748bb tempest-VolumesTransfersTest-851124297 None] Created reservations ['f745c9a1-7c16-4f2e-9aa2-c6fece303dbe', '426918ab-ba23-4b93-9e16-96670179b146', 'f4d1faea-3f8f-4058-8fef-4800113ded3a', '5e111685-1f6e-4804-93d5-90061e81a345'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-eeadbe91-78f4-4b42-9db6-5725b74748bb tempest-VolumesTransfersTest-851124297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-eeadbe91-78f4-4b42-9db6-5725b74748bb tempest-VolumesTransfersTest-851124297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-eeadbe91-78f4-4b42-9db6-5725b74748bb tempest-VolumesTransfersTest-851124297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-eeadbe91-78f4-4b42-9db6-5725b74748bb tempest-VolumesTransfersTest-851124297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-eeadbe91-78f4-4b42-9db6-5725b74748bb tempest-VolumesTransfersTest-851124297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eeadbe91-78f4-4b42-9db6-5725b74748bb tempest-VolumesTransfersTest-851124297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:30 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:19:30 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:30 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4c640bf6-06ab-49ec-8960-56da63394052" returned: 0 in 0.321s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:30 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-52f69649-f459-4e88-94bf-baca50edec7b tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9" returned: 0 in 0.449s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-52f69649-f459-4e88-94bf-baca50edec7b tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Attempting download of 97d73ec3-9d73-4df3-baa6-cc90fa33d35e ((None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}])) to volume 4c640bf6-06ab-49ec-8960-56da63394052. {{(pid=87568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 12:19:30 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9 Jul 22 12:19:30 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:30 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eeadbe91-78f4-4b42-9db6-5725b74748bb tempest-VolumesTransfersTest-851124297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.317s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-eeadbe91-78f4-4b42-9db6-5725b74748bb tempest-VolumesTransfersTest-851124297 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdad2c2-6ad9-4517-aaa4-45e49c1286f2]: (4, 'raw') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_1duegycn {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:30 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-eeadbe91-78f4-4b42-9db6-5725b74748bb tempest-VolumesTransfersTest-851124297 None] Deleted volume successfully. Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-eeadbe91-78f4-4b42-9db6-5725b74748bb tempest-VolumesTransfersTest-851124297 None] Lock "cinder-e810ca84-df2f-446a-b03f-a6900635c02b-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:30 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_1duegycn Jul 22 12:19:30 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:30 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-52f69649-f459-4e88-94bf-baca50edec7b tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff.2ca197a7-869e-4ec2-a9b3-323bb08b15e9" returned: 0 in 0.334s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-52f69649-f459-4e88-94bf-baca50edec7b tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-2ca197a7-869e-4ec2-a9b3-323bb08b15e9" released by "_delete_snapshot" :: held 2.088s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-52f69649-f459-4e88-94bf-baca50edec7b tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-5fa761ad-3c04-4072-b1f5-7c415b2d56ff" released by "delete_snapshot" :: held 2.129s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:31 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-52f69649-f459-4e88-94bf-baca50edec7b tempest-VolumesSnapshotTestJSON-493288019 None] Created reservations ['533730e8-2b89-4b56-afb2-1669d1f79d13', '39ec7b8c-d78b-49ea-adb4-3f6da24b7051', '6b52f7b2-7a1f-42f7-bd0a-d4eb9c8756db', 'd8f50bf2-6b72-481f-ae44-1bc9feeb3bf9'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:19:31 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_1duegycn" returned: 0 in 0.473s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_1duegycn {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:31 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-52f69649-f459-4e88-94bf-baca50edec7b tempest-VolumesSnapshotTestJSON-493288019 None] Delete snapshot completed successfully. Jul 22 12:19:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-52f69649-f459-4e88-94bf-baca50edec7b tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-2ca197a7-869e-4ec2-a9b3-323bb08b15e9-delete_snapshot" released by "delete_snapshot" :: held 2.388s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:31 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_1duegycn Jul 22 12:19:31 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:31 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_1duegycn" returned: 1 in 0.570s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_1duegycn' failed. Not Retrying. {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:19:31 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd014ec-b295-4418-bcfa-cc67888b2e76]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5ky1pfgsdevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:31 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5ky1pfgsdevstack@QuobyteHD Jul 22 12:19:31 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6b01df6e-4ee3-48fc-ab41-65e82843f23a tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-5fa761ad-3c04-4072-b1f5-7c415b2d56ff-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6b01df6e-4ee3-48fc-ab41-65e82843f23a tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-5fa761ad-3c04-4072-b1f5-7c415b2d56ff-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6b01df6e-4ee3-48fc-ab41-65e82843f23a tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-quobyte-5fa761ad-3c04-4072-b1f5-7c415b2d56ff" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6b01df6e-4ee3-48fc-ab41-65e82843f23a tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-5fa761ad-3c04-4072-b1f5-7c415b2d56ff" acquired by "delete_volume" :: waited 0.027s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:32 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5ky1pfgsdevstack@QuobyteHD" returned: 0 in 0.739s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:32 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] 97d73ec3-9d73-4df3-baa6-cc90fa33d35e was qcow2, converting to qcow2 {{(pid=87568) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 12:19:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5ky1pfgsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4c640bf6-06ab-49ec-8960-56da63394052 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:32 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[de629964-26b2-402e-b422-3051bc7cf859]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6b01df6e-4ee3-48fc-ab41-65e82843f23a tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:32 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5ky1pfgsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4c640bf6-06ab-49ec-8960-56da63394052 Jul 22 12:19:32 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:32 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff Jul 22 12:19:32 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:33 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6b01df6e-4ee3-48fc-ab41-65e82843f23a tempest-VolumesSnapshotTestJSON-493288019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff" returned: 0 in 0.648s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6b01df6e-4ee3-48fc-ab41-65e82843f23a tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:33 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff Jul 22 12:19:33 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:33 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6b01df6e-4ee3-48fc-ab41-65e82843f23a tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5fa761ad-3c04-4072-b1f5-7c415b2d56ff" returned: 0 in 0.370s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6b01df6e-4ee3-48fc-ab41-65e82843f23a tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-5fa761ad-3c04-4072-b1f5-7c415b2d56ff" released by "delete_volume" :: held 1.236s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:33 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-6b01df6e-4ee3-48fc-ab41-65e82843f23a tempest-VolumesSnapshotTestJSON-493288019 None] Created reservations ['f15ef996-16eb-4728-9d16-7d4d31b031de', 'a70eefcb-35f6-402d-85ed-6ac08f998e2d', '80ee0f4a-0776-42b0-b0d1-ca7cdd250b7c', 'df7790bb-8571-4c91-ab90-4a62b2f3032c'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:19:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6b01df6e-4ee3-48fc-ab41-65e82843f23a tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6b01df6e-4ee3-48fc-ab41-65e82843f23a tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6b01df6e-4ee3-48fc-ab41-65e82843f23a tempest-VolumesSnapshotTestJSON-493288019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6b01df6e-4ee3-48fc-ab41-65e82843f23a tempest-VolumesSnapshotTestJSON-493288019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6b01df6e-4ee3-48fc-ab41-65e82843f23a tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6b01df6e-4ee3-48fc-ab41-65e82843f23a tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:33 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:19:33 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:34 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6b01df6e-4ee3-48fc-ab41-65e82843f23a tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.322s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:34 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-6b01df6e-4ee3-48fc-ab41-65e82843f23a tempest-VolumesSnapshotTestJSON-493288019 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:19:34 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-6b01df6e-4ee3-48fc-ab41-65e82843f23a tempest-VolumesSnapshotTestJSON-493288019 None] Deleted volume successfully. Jul 22 12:19:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6b01df6e-4ee3-48fc-ab41-65e82843f23a tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-5fa761ad-3c04-4072-b1f5-7c415b2d56ff-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-98cf75fb-ad83-416a-a9e5-19008a3c6ec6 tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-4910087a-4deb-42ad-a177-91a7599293a7-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-98cf75fb-ad83-416a-a9e5-19008a3c6ec6 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-4910087a-4deb-42ad-a177-91a7599293a7-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-98cf75fb-ad83-416a-a9e5-19008a3c6ec6 tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "cinder-quobyte-4910087a-4deb-42ad-a177-91a7599293a7" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-98cf75fb-ad83-416a-a9e5-19008a3c6ec6 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-4910087a-4deb-42ad-a177-91a7599293a7" acquired by "delete_volume" :: waited 0.029s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:34 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff92c0b-5254-4384-978c-bc71461b721d]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-98cf75fb-ad83-416a-a9e5-19008a3c6ec6 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:35 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7 Jul 22 12:19:35 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:35 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5ky1pfgsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4c640bf6-06ab-49ec-8960-56da63394052" returned: 0 in 2.821s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:35 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_97d73ec3-9d73-4df3-baa6-cc90fa33d35e_5ky1pfgsdevstack@QuobyteHD, size 112.00 MB, duration 2.83 sec, destination /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4c640bf6-06ab-49ec-8960-56da63394052 {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:19:35 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Converted 112.00 MB image at 39.63 MB/s Jul 22 12:19:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4c640bf6-06ab-49ec-8960-56da63394052 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:35 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4c640bf6-06ab-49ec-8960-56da63394052 1G Jul 22 12:19:35 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:35 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-98cf75fb-ad83-416a-a9e5-19008a3c6ec6 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7" returned: 0 in 0.634s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-98cf75fb-ad83-416a-a9e5-19008a3c6ec6 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:35 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7 Jul 22 12:19:35 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:35 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-98cf75fb-ad83-416a-a9e5-19008a3c6ec6 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4910087a-4deb-42ad-a177-91a7599293a7" returned: 0 in 0.295s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-98cf75fb-ad83-416a-a9e5-19008a3c6ec6 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-quobyte-4910087a-4deb-42ad-a177-91a7599293a7" released by "delete_volume" :: held 1.033s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:35 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4c640bf6-06ab-49ec-8960-56da63394052 1G" returned: 0 in 0.520s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:35 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Downloaded image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e ((None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}])) to volume 4c640bf6-06ab-49ec-8960-56da63394052 successfully. {{(pid=87568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 12:19:35 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Temporary image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e for user 460053ab3ac546b7a2c813ccf557f9d8 is deleted. {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 12:19:35 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Marking volume 4c640bf6-06ab-49ec-8960-56da63394052 as bootable. {{(pid=87568) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 12:19:35 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Copying metadata from image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e to 4c640bf6-06ab-49ec-8960-56da63394052. {{(pid=87568) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 12:19:35 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Creating volume glance metadata for volume 4c640bf6-06ab-49ec-8960-56da63394052 backed by image 97d73ec3-9d73-4df3-baa6-cc90fa33d35e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87568) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 12:19:35 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-98cf75fb-ad83-416a-a9e5-19008a3c6ec6 tempest-VolumesSnapshotTestJSON-493288019 None] Created reservations ['ef0bec43-8b8a-46c1-ae0f-f84b5b9df15a', '47db7b84-2af1-45cd-abf7-92ec55cee808', '8df8d301-21b6-4117-94d3-e7d34bb3765e', '09450e31-ec18-4f47-a226-0194f46183a4'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:19:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a64017-421b-431f-9e38-395f69626657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c640bf6-06ab-49ec-8960-56da63394052', 'volume_size': 1, 'image_id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fe02ba8749e04b7eaeb23823f684fdc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97d73ec3-9d73-4df3-baa6-cc90fa33d35e', 'created_at': datetime.datetime(2026, 7, 22, 10, 2, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 2, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97d73ec3-9d73-4df3-baa6-cc90fa33d35e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e2ecc4-2102-4457-8f1c-4a7129947979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:36 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Volume volume-4c640bf6-06ab-49ec-8960-56da63394052 (4c640bf6-06ab-49ec-8960-56da63394052): created successfully Jul 22 12:19:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e2ecc4-2102-4457-8f1c-4a7129947979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Flow 'volume_create_manager' (fc1b9db0-e75b-4e5f-b22c-73c6b7537e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-98cf75fb-ad83-416a-a9e5-19008a3c6ec6 tempest-VolumesSnapshotTestJSON-493288019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-98cf75fb-ad83-416a-a9e5-19008a3c6ec6 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-98cf75fb-ad83-416a-a9e5-19008a3c6ec6 tempest-VolumesSnapshotTestJSON-493288019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-98cf75fb-ad83-416a-a9e5-19008a3c6ec6 tempest-VolumesSnapshotTestJSON-493288019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-98cf75fb-ad83-416a-a9e5-19008a3c6ec6 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-98cf75fb-ad83-416a-a9e5-19008a3c6ec6 tempest-VolumesSnapshotTestJSON-493288019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:36 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-1053639a-25ab-4dac-bfef-27186aa92b5c tempest-VolumesGetTest-991120179 None] Created volume successfully. Jul 22 12:19:36 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:19:36 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:36 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-98cf75fb-ad83-416a-a9e5-19008a3c6ec6 tempest-VolumesSnapshotTestJSON-493288019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.384s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:36 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-98cf75fb-ad83-416a-a9e5-19008a3c6ec6 tempest-VolumesSnapshotTestJSON-493288019 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:19:36 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-98cf75fb-ad83-416a-a9e5-19008a3c6ec6 tempest-VolumesSnapshotTestJSON-493288019 None] Deleted volume successfully. Jul 22 12:19:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-98cf75fb-ad83-416a-a9e5-19008a3c6ec6 tempest-VolumesSnapshotTestJSON-493288019 None] Lock "cinder-4910087a-4deb-42ad-a177-91a7599293a7-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:37 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:19:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Flow 'volume_create_manager' (fe33ae2d-a4b0-4509-8123-a5dada836c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2343b09a-cd71-45c5-b544-2a3461cace5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2343b09a-cd71-45c5-b544-2a3461cace5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1147170771',display_name='tempest-VolumesGetTest-Volume-621083741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ba59ed-228f-4412-a5bb-fbf6499ecd80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18dbab1b06b413eaf97890d9bb678b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:37Z,use_quota=True,user_id='460053ab3ac546b7a2c813ccf557f9d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af655ba-f5d2-4c9d-8ca1-6c85e0b5be0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af655ba-f5d2-4c9d-8ca1-6c85e0b5be0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d2cac7-52b8-4222-a51d-111e08801434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d2cac7-52b8-4222-a51d-111e08801434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37ba59ed-228f-4412-a5bb-fbf6499ecd80', 'volume_name': 'volume-37ba59ed-228f-4412-a5bb-fbf6499ecd80', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f89d3ba6-61f3-492f-8888-c84856d048eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f89d3ba6-61f3-492f-8888-c84856d048eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6885397-5052-4e13-95dd-813afdd694cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:37 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Volume 37ba59ed-228f-4412-a5bb-fbf6499ecd80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37ba59ed-228f-4412-a5bb-fbf6499ecd80', 'volume_size': 1} Jul 22 12:19:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1147170771',display_name='tempest-VolumesGetTest-Volume-621083741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ba59ed-228f-4412-a5bb-fbf6499ecd80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18dbab1b06b413eaf97890d9bb678b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:37Z,use_quota=True,user_id='460053ab3ac546b7a2c813ccf557f9d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:19:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Creating volume 37ba59ed-228f-4412-a5bb-fbf6499ecd80 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:19:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:19:37 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:19:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-37ba59ed-228f-4412-a5bb-fbf6499ecd80 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:37 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-37ba59ed-228f-4412-a5bb-fbf6499ecd80 1073741824 Jul 22 12:19:37 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:38 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-37ba59ed-228f-4412-a5bb-fbf6499ecd80 1073741824" returned: 0 in 0.713s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-37ba59ed-228f-4412-a5bb-fbf6499ecd80 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:38 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-37ba59ed-228f-4412-a5bb-fbf6499ecd80 Jul 22 12:19:38 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:38 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-37ba59ed-228f-4412-a5bb-fbf6499ecd80" returned: 0 in 0.306s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:19:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6885397-5052-4e13-95dd-813afdd694cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37ba59ed-228f-4412-a5bb-fbf6499ecd80', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d844997a-d8c7-4718-a914-acfbf7c754d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:38 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Volume volume-37ba59ed-228f-4412-a5bb-fbf6499ecd80 (37ba59ed-228f-4412-a5bb-fbf6499ecd80): created successfully Jul 22 12:19:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d844997a-d8c7-4718-a914-acfbf7c754d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Flow 'volume_create_manager' (fe33ae2d-a4b0-4509-8123-a5dada836c7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:38 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d2f76989-3654-44b5-8e95-41cd8b9d641d tempest-VolumesGetTest-991120179 None] Created volume successfully. Jul 22 12:19:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4b732688-aa6b-4516-80ee-1a2b45473d5a tempest-VolumesGetTest-991120179 None] Acquiring lock "cinder-37ba59ed-228f-4412-a5bb-fbf6499ecd80-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4b732688-aa6b-4516-80ee-1a2b45473d5a tempest-VolumesGetTest-991120179 None] Lock "cinder-37ba59ed-228f-4412-a5bb-fbf6499ecd80-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4b732688-aa6b-4516-80ee-1a2b45473d5a tempest-VolumesGetTest-991120179 None] Acquiring lock "cinder-quobyte-37ba59ed-228f-4412-a5bb-fbf6499ecd80" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4b732688-aa6b-4516-80ee-1a2b45473d5a tempest-VolumesGetTest-991120179 None] Lock "cinder-quobyte-37ba59ed-228f-4412-a5bb-fbf6499ecd80" acquired by "delete_volume" :: waited 0.028s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:39 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6260dd-aaaf-4258-af59-ffea2ed2dd6a]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4b732688-aa6b-4516-80ee-1a2b45473d5a tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-37ba59ed-228f-4412-a5bb-fbf6499ecd80 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:40 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-37ba59ed-228f-4412-a5bb-fbf6499ecd80 Jul 22 12:19:40 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:40 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4b732688-aa6b-4516-80ee-1a2b45473d5a tempest-VolumesGetTest-991120179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-37ba59ed-228f-4412-a5bb-fbf6499ecd80" returned: 0 in 0.546s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4b732688-aa6b-4516-80ee-1a2b45473d5a tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-37ba59ed-228f-4412-a5bb-fbf6499ecd80 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:40 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-37ba59ed-228f-4412-a5bb-fbf6499ecd80 Jul 22 12:19:40 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:40 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4b732688-aa6b-4516-80ee-1a2b45473d5a tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-37ba59ed-228f-4412-a5bb-fbf6499ecd80" returned: 0 in 0.451s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4b732688-aa6b-4516-80ee-1a2b45473d5a tempest-VolumesGetTest-991120179 None] Lock "cinder-quobyte-37ba59ed-228f-4412-a5bb-fbf6499ecd80" released by "delete_volume" :: held 1.079s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:40 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-4b732688-aa6b-4516-80ee-1a2b45473d5a tempest-VolumesGetTest-991120179 None] Created reservations ['19734aab-2409-4e8f-848f-d0919c56e543', '22ec6498-8e15-43f3-aad4-0f36ffb170d2', '333b6d8e-f5c5-4578-8180-e875c5e16bd3', '266dd0a0-e1bf-4a24-a1a3-140d74b4b0dc'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:19:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4b732688-aa6b-4516-80ee-1a2b45473d5a tempest-VolumesGetTest-991120179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4b732688-aa6b-4516-80ee-1a2b45473d5a tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4b732688-aa6b-4516-80ee-1a2b45473d5a tempest-VolumesGetTest-991120179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4b732688-aa6b-4516-80ee-1a2b45473d5a tempest-VolumesGetTest-991120179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4b732688-aa6b-4516-80ee-1a2b45473d5a tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4b732688-aa6b-4516-80ee-1a2b45473d5a tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:41 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:19:41 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:41 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4b732688-aa6b-4516-80ee-1a2b45473d5a tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.365s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:41 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-4b732688-aa6b-4516-80ee-1a2b45473d5a tempest-VolumesGetTest-991120179 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:19:41 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-4b732688-aa6b-4516-80ee-1a2b45473d5a tempest-VolumesGetTest-991120179 None] Deleted volume successfully. Jul 22 12:19:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4b732688-aa6b-4516-80ee-1a2b45473d5a tempest-VolumesGetTest-991120179 None] Lock "cinder-37ba59ed-228f-4412-a5bb-fbf6499ecd80-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Flow 'volume_create_manager' (428fb90f-b23b-4808-b046-6d0437c38f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6796533-2cb5-424d-a770-d0a71f5fc41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6796533-2cb5-424d-a770-d0a71f5fc41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-712573492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1660b2a-c8ff-4a70-b04e-383a5273d690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3db875cf9f478bad5ef5e73b2313ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:42Z,use_quota=True,user_id='ff743119dfbd424cac9e3429389f9205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12bbcab-3bd1-41ea-9489-5ee8a33bd5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12bbcab-3bd1-41ea-9489-5ee8a33bd5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5b8ec6-3fd2-4bc9-a7fb-c403972adbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5b8ec6-3fd2-4bc9-a7fb-c403972adbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1660b2a-c8ff-4a70-b04e-383a5273d690', 'volume_name': 'volume-f1660b2a-c8ff-4a70-b04e-383a5273d690', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f59098-c1cd-4c75-b38a-32c5ac77c2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f59098-c1cd-4c75-b38a-32c5ac77c2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c985e10-2eb3-41e5-8b77-f4ccdea4994e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:42 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Volume f1660b2a-c8ff-4a70-b04e-383a5273d690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1660b2a-c8ff-4a70-b04e-383a5273d690', 'volume_size': 1} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-712573492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1660b2a-c8ff-4a70-b04e-383a5273d690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3db875cf9f478bad5ef5e73b2313ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:42Z,use_quota=True,user_id='ff743119dfbd424cac9e3429389f9205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Creating volume f1660b2a-c8ff-4a70-b04e-383a5273d690 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:19:42 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1660b2a-c8ff-4a70-b04e-383a5273d690 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9874426f-3dcc-4c85-82bb-c8c2346e40e8 tempest-VolumesGetTest-991120179 None] Acquiring lock "cinder-4c640bf6-06ab-49ec-8960-56da63394052-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:42 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1660b2a-c8ff-4a70-b04e-383a5273d690 1073741824 Jul 22 12:19:42 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9874426f-3dcc-4c85-82bb-c8c2346e40e8 tempest-VolumesGetTest-991120179 None] Lock "cinder-4c640bf6-06ab-49ec-8960-56da63394052-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9874426f-3dcc-4c85-82bb-c8c2346e40e8 tempest-VolumesGetTest-991120179 None] Acquiring lock "cinder-quobyte-4c640bf6-06ab-49ec-8960-56da63394052" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9874426f-3dcc-4c85-82bb-c8c2346e40e8 tempest-VolumesGetTest-991120179 None] Lock "cinder-quobyte-4c640bf6-06ab-49ec-8960-56da63394052" acquired by "delete_volume" :: waited 0.023s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6374a7f5-7aa9-4256-be4e-785dd6b03e46]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9874426f-3dcc-4c85-82bb-c8c2346e40e8 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4c640bf6-06ab-49ec-8960-56da63394052 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:42 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4c640bf6-06ab-49ec-8960-56da63394052 Jul 22 12:19:42 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:42 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1660b2a-c8ff-4a70-b04e-383a5273d690 1073741824" returned: 0 in 0.589s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1660b2a-c8ff-4a70-b04e-383a5273d690 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:42 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9874426f-3dcc-4c85-82bb-c8c2346e40e8 tempest-VolumesGetTest-991120179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4c640bf6-06ab-49ec-8960-56da63394052" returned: 0 in 0.493s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9874426f-3dcc-4c85-82bb-c8c2346e40e8 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4c640bf6-06ab-49ec-8960-56da63394052 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:42 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1660b2a-c8ff-4a70-b04e-383a5273d690 Jul 22 12:19:42 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:43 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4c640bf6-06ab-49ec-8960-56da63394052 Jul 22 12:19:43 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:43 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1660b2a-c8ff-4a70-b04e-383a5273d690" returned: 0 in 0.337s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:43 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:19:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c985e10-2eb3-41e5-8b77-f4ccdea4994e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1660b2a-c8ff-4a70-b04e-383a5273d690', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8c9d03-0620-4567-9ec0-f2ec1ff81671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:43 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Volume volume-f1660b2a-c8ff-4a70-b04e-383a5273d690 (f1660b2a-c8ff-4a70-b04e-383a5273d690): created successfully Jul 22 12:19:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8c9d03-0620-4567-9ec0-f2ec1ff81671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Flow 'volume_create_manager' (428fb90f-b23b-4808-b046-6d0437c38f40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:43 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-a417ed7b-da68-4843-a3ae-b2953867f236 tempest-VolumesTransfersV357Test-1374150116 None] Created volume successfully. Jul 22 12:19:43 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9874426f-3dcc-4c85-82bb-c8c2346e40e8 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4c640bf6-06ab-49ec-8960-56da63394052" returned: 0 in 0.431s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:43 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9874426f-3dcc-4c85-82bb-c8c2346e40e8 tempest-VolumesGetTest-991120179 None] Lock "cinder-quobyte-4c640bf6-06ab-49ec-8960-56da63394052" released by "delete_volume" :: held 0.984s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:43 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-9874426f-3dcc-4c85-82bb-c8c2346e40e8 tempest-VolumesGetTest-991120179 None] Created reservations ['cc4454bb-b1ab-45aa-9a8c-7f9176f076be', '77c735e2-1f45-4343-9f21-0847f8150d85', '7e4304cb-0d55-4157-a0c0-426ec8de4217', 'e29511fd-74a7-49ec-a2c0-213618cf6d01'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:19:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9874426f-3dcc-4c85-82bb-c8c2346e40e8 tempest-VolumesGetTest-991120179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9874426f-3dcc-4c85-82bb-c8c2346e40e8 tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:43 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9874426f-3dcc-4c85-82bb-c8c2346e40e8 tempest-VolumesGetTest-991120179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:43 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9874426f-3dcc-4c85-82bb-c8c2346e40e8 tempest-VolumesGetTest-991120179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9874426f-3dcc-4c85-82bb-c8c2346e40e8 tempest-VolumesGetTest-991120179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9874426f-3dcc-4c85-82bb-c8c2346e40e8 tempest-VolumesGetTest-991120179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:43 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:19:43 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:43 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9874426f-3dcc-4c85-82bb-c8c2346e40e8 tempest-VolumesGetTest-991120179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.264s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:43 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-9874426f-3dcc-4c85-82bb-c8c2346e40e8 tempest-VolumesGetTest-991120179 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:19:43 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-9874426f-3dcc-4c85-82bb-c8c2346e40e8 tempest-VolumesGetTest-991120179 None] Deleted volume successfully. Jul 22 12:19:43 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9874426f-3dcc-4c85-82bb-c8c2346e40e8 tempest-VolumesGetTest-991120179 None] Lock "cinder-4c640bf6-06ab-49ec-8960-56da63394052-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:45 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-5641c6e5-b876-4daa-a5fa-974e186a3979 tempest-VolumesTransfersV357Test-1773493569 None] Transfer volume completed successfully. Jul 22 12:19:45 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-11ad7bbb-e6ac-47d6-9ecb-1975c67ed8ed tempest-VolumesTransfersV357Test-1489972379 None] Acquiring lock "cinder-f1660b2a-c8ff-4a70-b04e-383a5273d690-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:45 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-11ad7bbb-e6ac-47d6-9ecb-1975c67ed8ed tempest-VolumesTransfersV357Test-1489972379 None] Lock "cinder-f1660b2a-c8ff-4a70-b04e-383a5273d690-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:45 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-11ad7bbb-e6ac-47d6-9ecb-1975c67ed8ed tempest-VolumesTransfersV357Test-1489972379 None] Acquiring lock "cinder-quobyte-f1660b2a-c8ff-4a70-b04e-383a5273d690" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:46 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-11ad7bbb-e6ac-47d6-9ecb-1975c67ed8ed tempest-VolumesTransfersV357Test-1489972379 None] Lock "cinder-quobyte-f1660b2a-c8ff-4a70-b04e-383a5273d690" acquired by "delete_volume" :: waited 0.040s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:46 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[057cd65d-2c79-4a0b-902b-0e6dbc2524ba]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-11ad7bbb-e6ac-47d6-9ecb-1975c67ed8ed tempest-VolumesTransfersV357Test-1489972379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1660b2a-c8ff-4a70-b04e-383a5273d690 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:46 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1660b2a-c8ff-4a70-b04e-383a5273d690 Jul 22 12:19:46 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:46 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-11ad7bbb-e6ac-47d6-9ecb-1975c67ed8ed tempest-VolumesTransfersV357Test-1489972379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1660b2a-c8ff-4a70-b04e-383a5273d690" returned: 0 in 0.476s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-11ad7bbb-e6ac-47d6-9ecb-1975c67ed8ed tempest-VolumesTransfersV357Test-1489972379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1660b2a-c8ff-4a70-b04e-383a5273d690 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:46 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1660b2a-c8ff-4a70-b04e-383a5273d690 Jul 22 12:19:46 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:46 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-11ad7bbb-e6ac-47d6-9ecb-1975c67ed8ed tempest-VolumesTransfersV357Test-1489972379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f1660b2a-c8ff-4a70-b04e-383a5273d690" returned: 0 in 0.301s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:46 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-11ad7bbb-e6ac-47d6-9ecb-1975c67ed8ed tempest-VolumesTransfersV357Test-1489972379 None] Lock "cinder-quobyte-f1660b2a-c8ff-4a70-b04e-383a5273d690" released by "delete_volume" :: held 0.845s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:46 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-11ad7bbb-e6ac-47d6-9ecb-1975c67ed8ed tempest-VolumesTransfersV357Test-1489972379 None] Created reservations ['22287946-8ef0-498d-a228-d9264e08a565', '18012598-4525-4e9d-bb34-a8915da877c4', '9d031498-d993-4230-8474-344a75c5e5bc', '9d88a782-808f-402c-88ea-c9f897e37016'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:19:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-11ad7bbb-e6ac-47d6-9ecb-1975c67ed8ed tempest-VolumesTransfersV357Test-1489972379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-11ad7bbb-e6ac-47d6-9ecb-1975c67ed8ed tempest-VolumesTransfersV357Test-1489972379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:47 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-11ad7bbb-e6ac-47d6-9ecb-1975c67ed8ed tempest-VolumesTransfersV357Test-1489972379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:47 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-11ad7bbb-e6ac-47d6-9ecb-1975c67ed8ed tempest-VolumesTransfersV357Test-1489972379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-11ad7bbb-e6ac-47d6-9ecb-1975c67ed8ed tempest-VolumesTransfersV357Test-1489972379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-11ad7bbb-e6ac-47d6-9ecb-1975c67ed8ed tempest-VolumesTransfersV357Test-1489972379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:47 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:19:47 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:47 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-11ad7bbb-e6ac-47d6-9ecb-1975c67ed8ed tempest-VolumesTransfersV357Test-1489972379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.508s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:47 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-11ad7bbb-e6ac-47d6-9ecb-1975c67ed8ed tempest-VolumesTransfersV357Test-1489972379 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:19:47 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-11ad7bbb-e6ac-47d6-9ecb-1975c67ed8ed tempest-VolumesTransfersV357Test-1489972379 None] Deleted volume successfully. Jul 22 12:19:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-11ad7bbb-e6ac-47d6-9ecb-1975c67ed8ed tempest-VolumesTransfersV357Test-1489972379 None] Lock "cinder-f1660b2a-c8ff-4a70-b04e-383a5273d690-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Flow 'volume_create_manager' (6842f226-93b2-4435-a446-d26f18f39f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe6008c-9e59-4faf-9fb5-65dada446b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe6008c-9e59-4faf-9fb5-65dada446b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1798251718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae7ff4f-71f6-43a7-9333-c9b45c0867b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3db875cf9f478bad5ef5e73b2313ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:48Z,use_quota=True,user_id='ff743119dfbd424cac9e3429389f9205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82aca0c-357d-4315-8f6d-1400e72d8e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82aca0c-357d-4315-8f6d-1400e72d8e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46dfb20-c17b-48d0-a2b6-e354b9e1cd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46dfb20-c17b-48d0-a2b6-e354b9e1cd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dae7ff4f-71f6-43a7-9333-c9b45c0867b7', 'volume_name': 'volume-dae7ff4f-71f6-43a7-9333-c9b45c0867b7', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b52ac3-d8db-4686-aee7-57c73dacc47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b52ac3-d8db-4686-aee7-57c73dacc47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8512a707-6dae-46e2-bae2-c72e75d72550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:48 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Volume dae7ff4f-71f6-43a7-9333-c9b45c0867b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dae7ff4f-71f6-43a7-9333-c9b45c0867b7', 'volume_size': 1} Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1798251718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae7ff4f-71f6-43a7-9333-c9b45c0867b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3db875cf9f478bad5ef5e73b2313ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:48Z,use_quota=True,user_id='ff743119dfbd424cac9e3429389f9205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Creating volume dae7ff4f-71f6-43a7-9333-c9b45c0867b7 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:19:48 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dae7ff4f-71f6-43a7-9333-c9b45c0867b7 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:48 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dae7ff4f-71f6-43a7-9333-c9b45c0867b7 1073741824 Jul 22 12:19:48 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:48 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dae7ff4f-71f6-43a7-9333-c9b45c0867b7 1073741824" returned: 0 in 0.549s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dae7ff4f-71f6-43a7-9333-c9b45c0867b7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:48 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dae7ff4f-71f6-43a7-9333-c9b45c0867b7 Jul 22 12:19:48 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:49 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dae7ff4f-71f6-43a7-9333-c9b45c0867b7" returned: 0 in 0.447s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8512a707-6dae-46e2-bae2-c72e75d72550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dae7ff4f-71f6-43a7-9333-c9b45c0867b7', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d848a1-1272-4f6e-910a-6b8d519591e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:49 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Volume volume-dae7ff4f-71f6-43a7-9333-c9b45c0867b7 (dae7ff4f-71f6-43a7-9333-c9b45c0867b7): created successfully Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d848a1-1272-4f6e-910a-6b8d519591e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Flow 'volume_create_manager' (6842f226-93b2-4435-a446-d26f18f39f74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:49 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-eff5eafe-5088-4930-84fb-7e4e3391313c tempest-VolumesTransfersV357Test-1374150116 None] Created volume successfully. Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Flow 'volume_create_manager' (5eec39ac-b93b-46b1-954e-56fc1f3a4344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e927d2c3-c191-4261-bd7d-f1e474459c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e927d2c3-c191-4261-bd7d-f1e474459c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1273427915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f45dfcc56340cc8778e176c15e3cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:49Z,use_quota=True,user_id='b008a8e410ae47c38ce7c32dab4573ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601a60c2-9e88-4b5f-b233-1547a3241c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601a60c2-9e88-4b5f-b233-1547a3241c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27592b90-15f9-42a7-ac4e-740b1cbe7b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27592b90-15f9-42a7-ac4e-740b1cbe7b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84', 'volume_name': 'volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84', 'volume_size': 2}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0f9ad9-f826-45af-a4d2-e43ad38366fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0f9ad9-f826-45af-a4d2-e43ad38366fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01be33bb-eb8e-4fc4-a0fe-7f5e3f3e40a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:49 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Volume b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84', 'volume_size': 2} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1273427915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f45dfcc56340cc8778e176c15e3cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:49Z,use_quota=True,user_id='b008a8e410ae47c38ce7c32dab4573ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Creating volume b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:19:49 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:19:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84 2147483648 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:49 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84 2147483648 Jul 22 12:19:49 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:50 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84 2147483648" returned: 0 in 0.566s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:50 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84 Jul 22 12:19:50 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:50 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-14706846-3571-4e2b-bc37-95ad1d4d623d tempest-VolumesTransfersV357Test-1489972379 None] Acquiring lock "cinder-dae7ff4f-71f6-43a7-9333-c9b45c0867b7-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:50 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84" returned: 0 in 0.316s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:50 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:19:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01be33bb-eb8e-4fc4-a0fe-7f5e3f3e40a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84', 'volume_size': 2}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97446e90-1873-476b-adfc-6f28b3d2f92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:50 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-14706846-3571-4e2b-bc37-95ad1d4d623d tempest-VolumesTransfersV357Test-1489972379 None] Lock "cinder-dae7ff4f-71f6-43a7-9333-c9b45c0867b7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:50 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Volume volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84 (b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84): created successfully Jul 22 12:19:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97446e90-1873-476b-adfc-6f28b3d2f92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Flow 'volume_create_manager' (5eec39ac-b93b-46b1-954e-56fc1f3a4344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:50 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-14706846-3571-4e2b-bc37-95ad1d4d623d tempest-VolumesTransfersV357Test-1489972379 None] Acquiring lock "cinder-quobyte-dae7ff4f-71f6-43a7-9333-c9b45c0867b7" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:50 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-7e196958-1438-4ef0-8b05-be899519f7f3 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Created volume successfully. Jul 22 12:19:50 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-14706846-3571-4e2b-bc37-95ad1d4d623d tempest-VolumesTransfersV357Test-1489972379 None] Lock "cinder-quobyte-dae7ff4f-71f6-43a7-9333-c9b45c0867b7" acquired by "delete_volume" :: waited 0.023s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:50 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c41e01b-131a-4393-9650-1bbe0736ad48]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-14706846-3571-4e2b-bc37-95ad1d4d623d tempest-VolumesTransfersV357Test-1489972379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dae7ff4f-71f6-43a7-9333-c9b45c0867b7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:50 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dae7ff4f-71f6-43a7-9333-c9b45c0867b7 Jul 22 12:19:50 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:51 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-14706846-3571-4e2b-bc37-95ad1d4d623d tempest-VolumesTransfersV357Test-1489972379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dae7ff4f-71f6-43a7-9333-c9b45c0867b7" returned: 0 in 0.478s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-14706846-3571-4e2b-bc37-95ad1d4d623d tempest-VolumesTransfersV357Test-1489972379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dae7ff4f-71f6-43a7-9333-c9b45c0867b7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:51 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dae7ff4f-71f6-43a7-9333-c9b45c0867b7 Jul 22 12:19:51 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:51 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-14706846-3571-4e2b-bc37-95ad1d4d623d tempest-VolumesTransfersV357Test-1489972379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dae7ff4f-71f6-43a7-9333-c9b45c0867b7" returned: 0 in 0.278s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:51 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-14706846-3571-4e2b-bc37-95ad1d4d623d tempest-VolumesTransfersV357Test-1489972379 None] Lock "cinder-quobyte-dae7ff4f-71f6-43a7-9333-c9b45c0867b7" released by "delete_volume" :: held 0.802s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:51 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-14706846-3571-4e2b-bc37-95ad1d4d623d tempest-VolumesTransfersV357Test-1489972379 None] Created reservations ['3abaaad7-2068-43d6-9e45-8091b0c3c144', '602c53fb-9d92-4d2e-ad32-f5a863682b31', '802709b0-0a38-4bf9-a0ea-77581525aab9', '60fa8f6a-a939-47e5-a222-01866febd0e4'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:19:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-14706846-3571-4e2b-bc37-95ad1d4d623d tempest-VolumesTransfersV357Test-1489972379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-14706846-3571-4e2b-bc37-95ad1d4d623d tempest-VolumesTransfersV357Test-1489972379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-14706846-3571-4e2b-bc37-95ad1d4d623d tempest-VolumesTransfersV357Test-1489972379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-14706846-3571-4e2b-bc37-95ad1d4d623d tempest-VolumesTransfersV357Test-1489972379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-14706846-3571-4e2b-bc37-95ad1d4d623d tempest-VolumesTransfersV357Test-1489972379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-14706846-3571-4e2b-bc37-95ad1d4d623d tempest-VolumesTransfersV357Test-1489972379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:51 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:19:51 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-55adc9ab-f890-459e-a221-7adc6ad65b71 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-55adc9ab-f890-459e-a221-7adc6ad65b71 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-55adc9ab-f890-459e-a221-7adc6ad65b71 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Creating offline snapshot 5847ca94-6270-47b6-8242-9077fe615637 of volume b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:19:51 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb9a8ef-5e39-4af6-b3df-a55b7a48f307]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-55adc9ab-f890-459e-a221-7adc6ad65b71 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:51 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-14706846-3571-4e2b-bc37-95ad1d4d623d tempest-VolumesTransfersV357Test-1489972379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.301s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:51 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-14706846-3571-4e2b-bc37-95ad1d4d623d tempest-VolumesTransfersV357Test-1489972379 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:19:51 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-14706846-3571-4e2b-bc37-95ad1d4d623d tempest-VolumesTransfersV357Test-1489972379 None] Deleted volume successfully. Jul 22 12:19:51 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-14706846-3571-4e2b-bc37-95ad1d4d623d tempest-VolumesTransfersV357Test-1489972379 None] Lock "cinder-dae7ff4f-71f6-43a7-9333-c9b45c0867b7-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:52 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84 Jul 22 12:19:52 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:52 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-55adc9ab-f890-459e-a221-7adc6ad65b71 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84" returned: 0 in 0.509s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-55adc9ab-f890-459e-a221-7adc6ad65b71 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.5847ca94-6270-47b6-8242-9077fe615637 2G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:52 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.5847ca94-6270-47b6-8242-9077fe615637 2G Jul 22 12:19:52 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:52 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-55adc9ab-f890-459e-a221-7adc6ad65b71 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.5847ca94-6270-47b6-8242-9077fe615637 2G" returned: 0 in 0.573s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-55adc9ab-f890-459e-a221-7adc6ad65b71 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.5847ca94-6270-47b6-8242-9077fe615637 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:52 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.5847ca94-6270-47b6-8242-9077fe615637 Jul 22 12:19:52 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:53 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-55adc9ab-f890-459e-a221-7adc6ad65b71 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.5847ca94-6270-47b6-8242-9077fe615637" returned: 0 in 0.361s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:53 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-55adc9ab-f890-459e-a221-7adc6ad65b71 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.5847ca94-6270-47b6-8242-9077fe615637 is being set with open permissions: ugo+rw Jul 22 12:19:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-55adc9ab-f890-459e-a221-7adc6ad65b71 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.5847ca94-6270-47b6-8242-9077fe615637 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:53 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.5847ca94-6270-47b6-8242-9077fe615637 Jul 22 12:19:53 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:53 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-55adc9ab-f890-459e-a221-7adc6ad65b71 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.5847ca94-6270-47b6-8242-9077fe615637" returned: 0 in 0.288s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:53 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=141,cinder:UPDATE=189,cinder:DELETE=17,cinder:INSERT=54 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:19:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-55adc9ab-f890-459e-a221-7adc6ad65b71 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:53 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.info Jul 22 12:19:53 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:53 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-55adc9ab-f890-459e-a221-7adc6ad65b71 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.info" returned: 0 in 0.362s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:53 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-55adc9ab-f890-459e-a221-7adc6ad65b71 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.info is being set with open permissions: ugo+rw Jul 22 12:19:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-55adc9ab-f890-459e-a221-7adc6ad65b71 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:53 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.info Jul 22 12:19:53 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:54 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-55adc9ab-f890-459e-a221-7adc6ad65b71 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.info" returned: 0 in 0.386s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-55adc9ab-f890-459e-a221-7adc6ad65b71 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.625s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:54 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-55adc9ab-f890-459e-a221-7adc6ad65b71 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Create snapshot completed successfully Jul 22 12:19:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-da762b55-67e1-4a34-9f2e-eba32bccf75e tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Acquiring lock "cinder-5847ca94-6270-47b6-8242-9077fe615637-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-da762b55-67e1-4a34-9f2e-eba32bccf75e tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Lock "cinder-5847ca94-6270-47b6-8242-9077fe615637-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-da762b55-67e1-4a34-9f2e-eba32bccf75e tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Acquiring lock "cinder-quobyte-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-da762b55-67e1-4a34-9f2e-eba32bccf75e tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Lock "cinder-quobyte-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-da762b55-67e1-4a34-9f2e-eba32bccf75e tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Acquiring lock "cinder-quobyte-5847ca94-6270-47b6-8242-9077fe615637" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-da762b55-67e1-4a34-9f2e-eba32bccf75e tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Lock "cinder-quobyte-5847ca94-6270-47b6-8242-9077fe615637" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:55 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-da762b55-67e1-4a34-9f2e-eba32bccf75e tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Deleting offline snapshot 5847ca94-6270-47b6-8242-9077fe615637 of volume b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:19:55 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-da762b55-67e1-4a34-9f2e-eba32bccf75e tempest-VolumesSnapshotNegativeTestJSON-864269455 None] snapshot_file for this snap is: volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.5847ca94-6270-47b6-8242-9077fe615637 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:19:55 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d271b620-5b7e-4ab7-bc19-b5f289ff5ea3]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-da762b55-67e1-4a34-9f2e-eba32bccf75e tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.5847ca94-6270-47b6-8242-9077fe615637 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:55 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.5847ca94-6270-47b6-8242-9077fe615637 Jul 22 12:19:55 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:55 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-da762b55-67e1-4a34-9f2e-eba32bccf75e tempest-VolumesSnapshotNegativeTestJSON-864269455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.5847ca94-6270-47b6-8242-9077fe615637" returned: 0 in 0.566s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:55 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-da762b55-67e1-4a34-9f2e-eba32bccf75e tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:19:55 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0f072f-f86b-42c2-8067-eefbe2b3d4a5]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-da762b55-67e1-4a34-9f2e-eba32bccf75e tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:55 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84 Jul 22 12:19:55 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:56 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-da762b55-67e1-4a34-9f2e-eba32bccf75e tempest-VolumesSnapshotNegativeTestJSON-864269455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84" returned: 0 in 0.488s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-da762b55-67e1-4a34-9f2e-eba32bccf75e tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.5847ca94-6270-47b6-8242-9077fe615637 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:56 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.5847ca94-6270-47b6-8242-9077fe615637 Jul 22 12:19:56 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:56 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-da762b55-67e1-4a34-9f2e-eba32bccf75e tempest-VolumesSnapshotNegativeTestJSON-864269455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.5847ca94-6270-47b6-8242-9077fe615637" returned: 0 in 0.489s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-da762b55-67e1-4a34-9f2e-eba32bccf75e tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.5847ca94-6270-47b6-8242-9077fe615637 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:56 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.5847ca94-6270-47b6-8242-9077fe615637 Jul 22 12:19:56 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:57 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-da762b55-67e1-4a34-9f2e-eba32bccf75e tempest-VolumesSnapshotNegativeTestJSON-864269455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84.5847ca94-6270-47b6-8242-9077fe615637" returned: 0 in 0.463s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-da762b55-67e1-4a34-9f2e-eba32bccf75e tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Lock "cinder-quobyte-5847ca94-6270-47b6-8242-9077fe615637" released by "_delete_snapshot" :: held 2.175s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-da762b55-67e1-4a34-9f2e-eba32bccf75e tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Lock "cinder-quobyte-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84" released by "delete_snapshot" :: held 2.209s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:57 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-da762b55-67e1-4a34-9f2e-eba32bccf75e tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Created reservations ['39afa88f-8146-403e-816e-f487d755bb2f', 'ac87ba4f-e48b-4687-8f15-60704f7d4cb0', '50a33b88-ffb8-40fd-baa5-ff5d06e8f5c3', '948f80d9-5478-409f-a2fd-fe04aab73659'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:19:57 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-da762b55-67e1-4a34-9f2e-eba32bccf75e tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Delete snapshot completed successfully. Jul 22 12:19:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-da762b55-67e1-4a34-9f2e-eba32bccf75e tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Lock "cinder-5847ca94-6270-47b6-8242-9077fe615637-delete_snapshot" released by "delete_snapshot" :: held 2.392s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-576bd253-41a2-4cb6-bbd0-dfd373c09190 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Acquiring lock "cinder-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-576bd253-41a2-4cb6-bbd0-dfd373c09190 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Lock "cinder-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-576bd253-41a2-4cb6-bbd0-dfd373c09190 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Acquiring lock "cinder-quobyte-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:19:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-576bd253-41a2-4cb6-bbd0-dfd373c09190 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Lock "cinder-quobyte-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84" acquired by "delete_volume" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:19:58 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1653c5d1-7e25-4c9d-a235-0abcbd29be6d]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:19:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-576bd253-41a2-4cb6-bbd0-dfd373c09190 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:58 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84 Jul 22 12:19:58 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:58 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-576bd253-41a2-4cb6-bbd0-dfd373c09190 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84" returned: 0 in 0.397s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-576bd253-41a2-4cb6-bbd0-dfd373c09190 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:59 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84 Jul 22 12:19:59 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:59 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-576bd253-41a2-4cb6-bbd0-dfd373c09190 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84" returned: 0 in 0.292s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-576bd253-41a2-4cb6-bbd0-dfd373c09190 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Lock "cinder-quobyte-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84" released by "delete_volume" :: held 0.777s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Flow 'volume_create_manager' (6572a59c-747f-484f-b357-3455ce835874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39310ebb-d473-4ecf-9e8e-2b573da74f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39310ebb-d473-4ecf-9e8e-2b573da74f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-569938424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ced00787c14abba8c89aefc7a584dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:59Z,use_quota=True,user_id='86f4b8261cae41febcff23dbfa22bdae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abd7e4b-aa54-42ea-b2eb-5c96277a6e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abd7e4b-aa54-42ea-b2eb-5c96277a6e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8538f0-5b0c-4e58-bf48-5860381b9e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8538f0-5b0c-4e58-bf48-5860381b9e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6', 'volume_name': 'volume-cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6', 'volume_size': 2}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7403d5dd-c035-4daf-b332-8010d9fd73cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7403d5dd-c035-4daf-b332-8010d9fd73cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0c28ae-ed2e-463d-8523-c084ceb09afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:19:59 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Volume cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6', 'volume_size': 2} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-569938424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ced00787c14abba8c89aefc7a584dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:19:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:19:59Z,use_quota=True,user_id='86f4b8261cae41febcff23dbfa22bdae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Creating volume cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:19:59 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6 2147483648 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:59 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6 2147483648 Jul 22 12:19:59 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-576bd253-41a2-4cb6-bbd0-dfd373c09190 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Created reservations ['f7f76913-6169-4f6c-90a5-82dcbac91905', '2248f000-ff76-44f2-86f5-3b8277dd2c08', 'd5cc01f1-f728-4f7e-8e13-bab8a75a0a70', '0f5c9920-b711-4c52-b75f-01bf4b086904'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-576bd253-41a2-4cb6-bbd0-dfd373c09190 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-576bd253-41a2-4cb6-bbd0-dfd373c09190 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-576bd253-41a2-4cb6-bbd0-dfd373c09190 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-576bd253-41a2-4cb6-bbd0-dfd373c09190 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-576bd253-41a2-4cb6-bbd0-dfd373c09190 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-576bd253-41a2-4cb6-bbd0-dfd373c09190 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:19:59 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:19:59 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:19:59 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-576bd253-41a2-4cb6-bbd0-dfd373c09190 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.376s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-576bd253-41a2-4cb6-bbd0-dfd373c09190 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:19:59 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-576bd253-41a2-4cb6-bbd0-dfd373c09190 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Deleted volume successfully. Jul 22 12:19:59 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-576bd253-41a2-4cb6-bbd0-dfd373c09190 tempest-VolumesSnapshotNegativeTestJSON-864269455 None] Lock "cinder-b01a7c06-0fa4-4f7a-b201-c58c9d9c9f84-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:20:00 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6 2147483648" returned: 0 in 0.671s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:00 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6 Jul 22 12:20:00 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:00 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6" returned: 0 in 0.299s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:20:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0c28ae-ed2e-463d-8523-c084ceb09afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6', 'volume_size': 2}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af84a00a-7617-406c-b601-f70a76395439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:00 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Volume volume-cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6 (cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6): created successfully Jul 22 12:20:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af84a00a-7617-406c-b601-f70a76395439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Flow 'volume_create_manager' (6572a59c-747f-484f-b357-3455ce835874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:00 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-9894e950-7167-448c-8655-1b76fc0308a5 tempest-VolumesCloneNegativeTest-155567543 None] Created volume successfully. Jul 22 12:20:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-81bed1c1-50d0-4804-93d8-ffdd8e5ba4ff tempest-VolumesCloneNegativeTest-155567543 None] Acquiring lock "cinder-cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:20:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-81bed1c1-50d0-4804-93d8-ffdd8e5ba4ff tempest-VolumesCloneNegativeTest-155567543 None] Lock "cinder-cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:20:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-81bed1c1-50d0-4804-93d8-ffdd8e5ba4ff tempest-VolumesCloneNegativeTest-155567543 None] Acquiring lock "cinder-quobyte-cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:20:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-81bed1c1-50d0-4804-93d8-ffdd8e5ba4ff tempest-VolumesCloneNegativeTest-155567543 None] Lock "cinder-quobyte-cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6" acquired by "delete_volume" :: waited 0.020s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:20:01 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a036d0-7d1f-4154-ad86-5446009d5731]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:20:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-81bed1c1-50d0-4804-93d8-ffdd8e5ba4ff tempest-VolumesCloneNegativeTest-155567543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:01 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6 Jul 22 12:20:01 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:02 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-81bed1c1-50d0-4804-93d8-ffdd8e5ba4ff tempest-VolumesCloneNegativeTest-155567543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6" returned: 0 in 0.420s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-81bed1c1-50d0-4804-93d8-ffdd8e5ba4ff tempest-VolumesCloneNegativeTest-155567543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:02 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6 Jul 22 12:20:02 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:02 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-81bed1c1-50d0-4804-93d8-ffdd8e5ba4ff tempest-VolumesCloneNegativeTest-155567543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6" returned: 0 in 0.367s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:02 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-81bed1c1-50d0-4804-93d8-ffdd8e5ba4ff tempest-VolumesCloneNegativeTest-155567543 None] Lock "cinder-quobyte-cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6" released by "delete_volume" :: held 0.845s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:20:02 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-81bed1c1-50d0-4804-93d8-ffdd8e5ba4ff tempest-VolumesCloneNegativeTest-155567543 None] Created reservations ['ba1d80d2-628d-4e9c-bcee-863a19646a7e', 'de73e9c3-0083-4703-b9b6-b990fb1e5c4d', '96596efc-c218-493c-b519-94be8e6fc959', 'c5651cbe-a5ef-4a20-a3a4-ff11e4acdb33'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:20:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-81bed1c1-50d0-4804-93d8-ffdd8e5ba4ff tempest-VolumesCloneNegativeTest-155567543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-81bed1c1-50d0-4804-93d8-ffdd8e5ba4ff tempest-VolumesCloneNegativeTest-155567543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-81bed1c1-50d0-4804-93d8-ffdd8e5ba4ff tempest-VolumesCloneNegativeTest-155567543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:20:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-81bed1c1-50d0-4804-93d8-ffdd8e5ba4ff tempest-VolumesCloneNegativeTest-155567543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:20:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-81bed1c1-50d0-4804-93d8-ffdd8e5ba4ff tempest-VolumesCloneNegativeTest-155567543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-81bed1c1-50d0-4804-93d8-ffdd8e5ba4ff tempest-VolumesCloneNegativeTest-155567543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:02 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:20:02 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:02 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-81bed1c1-50d0-4804-93d8-ffdd8e5ba4ff tempest-VolumesCloneNegativeTest-155567543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.338s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:02 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-81bed1c1-50d0-4804-93d8-ffdd8e5ba4ff tempest-VolumesCloneNegativeTest-155567543 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:20:03 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-81bed1c1-50d0-4804-93d8-ffdd8e5ba4ff tempest-VolumesCloneNegativeTest-155567543 None] Deleted volume successfully. Jul 22 12:20:03 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-81bed1c1-50d0-4804-93d8-ffdd8e5ba4ff tempest-VolumesCloneNegativeTest-155567543 None] Lock "cinder-cc0dcfe4-542d-407a-9e7e-bb42d87b7fd6-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:UPDATE=167,cinder:SELECT=131,cinder:DELETE=14,cinder:INSERT=43 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Flow 'volume_create_manager' (de9c196c-0b08-473a-bffb-d6f47c089872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b516fd-9acc-40d6-9777-6127161ce857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b516fd-9acc-40d6-9777-6127161ce857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-164621379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d20fc1b5-c2c8-402c-846c-b75ec5f570bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e88b70acc8c46608ffbea5cd2d8bc6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:11Z,use_quota=True,user_id='88c36c3d89e74c248ca35f7988539b35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c73b1f0d-96da-426c-9c5d-e97e7c7b36ec),volume_type_id=c73b1f0d-96da-426c-9c5d-e97e7c7b36ec)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca425a49-420f-4b33-91bf-2f5d65274870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca425a49-420f-4b33-91bf-2f5d65274870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c31d0875-0b1f-4a5c-92b7-5f3a58eb8dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c31d0875-0b1f-4a5c-92b7-5f3a58eb8dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd20fc1b5-c2c8-402c-846c-b75ec5f570bf', 'volume_name': 'volume-d20fc1b5-c2c8-402c-846c-b75ec5f570bf', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b229836e-4d73-4d8c-bf33-f908a9bfe557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b229836e-4d73-4d8c-bf33-f908a9bfe557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e32602-2c51-406f-92e2-0f64c5441548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:11 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Volume d20fc1b5-c2c8-402c-846c-b75ec5f570bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d20fc1b5-c2c8-402c-846c-b75ec5f570bf', 'volume_size': 1} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-164621379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d20fc1b5-c2c8-402c-846c-b75ec5f570bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e88b70acc8c46608ffbea5cd2d8bc6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:11Z,use_quota=True,user_id='88c36c3d89e74c248ca35f7988539b35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c73b1f0d-96da-426c-9c5d-e97e7c7b36ec),volume_type_id=c73b1f0d-96da-426c-9c5d-e97e7c7b36ec)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Creating volume d20fc1b5-c2c8-402c-846c-b75ec5f570bf {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:20:11 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d20fc1b5-c2c8-402c-846c-b75ec5f570bf 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:11 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d20fc1b5-c2c8-402c-846c-b75ec5f570bf 1073741824 Jul 22 12:20:11 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Flow 'volume_create_manager' (dd13c988-2725-4529-8b59-1d558d587a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd594c8-5d39-4ad5-b6aa-6b2c8f1ae8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd594c8-5d39-4ad5-b6aa-6b2c8f1ae8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2130079635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62eb484-642b-4dd4-8086-94bba1a93b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e88b70acc8c46608ffbea5cd2d8bc6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:12Z,use_quota=True,user_id='88c36c3d89e74c248ca35f7988539b35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4038f974-9e68-468e-9772-7fd1e4f241a6),volume_type_id=4038f974-9e68-468e-9772-7fd1e4f241a6)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab20cc6-03a6-4786-84b0-a9058dd2de0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab20cc6-03a6-4786-84b0-a9058dd2de0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717d7834-485c-48da-91e0-a57cb4617c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717d7834-485c-48da-91e0-a57cb4617c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd62eb484-642b-4dd4-8086-94bba1a93b9e', 'volume_name': 'volume-d62eb484-642b-4dd4-8086-94bba1a93b9e', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67957fa8-797e-4464-b2bd-b414d2fcabd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67957fa8-797e-4464-b2bd-b414d2fcabd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc7c3ab-5d38-47e8-bb6f-339ad5b3554d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:12 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Volume d62eb484-642b-4dd4-8086-94bba1a93b9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d62eb484-642b-4dd4-8086-94bba1a93b9e', 'volume_size': 1} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:12 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d20fc1b5-c2c8-402c-846c-b75ec5f570bf 1073741824" returned: 0 in 0.697s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d20fc1b5-c2c8-402c-846c-b75ec5f570bf {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:12 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d20fc1b5-c2c8-402c-846c-b75ec5f570bf Jul 22 12:20:12 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:12 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d20fc1b5-c2c8-402c-846c-b75ec5f570bf" returned: 0 in 0.415s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.543s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2130079635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62eb484-642b-4dd4-8086-94bba1a93b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e88b70acc8c46608ffbea5cd2d8bc6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:12Z,use_quota=True,user_id='88c36c3d89e74c248ca35f7988539b35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4038f974-9e68-468e-9772-7fd1e4f241a6),volume_type_id=4038f974-9e68-468e-9772-7fd1e4f241a6)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Creating volume d62eb484-642b-4dd4-8086-94bba1a93b9e {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:20:12 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d62eb484-642b-4dd4-8086-94bba1a93b9e 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:12 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d62eb484-642b-4dd4-8086-94bba1a93b9e 1073741824 Jul 22 12:20:12 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e32602-2c51-406f-92e2-0f64c5441548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d20fc1b5-c2c8-402c-846c-b75ec5f570bf', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a3aa19-b5f1-40e2-80ec-c275e0721a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:12 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Volume volume-d20fc1b5-c2c8-402c-846c-b75ec5f570bf (d20fc1b5-c2c8-402c-846c-b75ec5f570bf): created successfully Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a3aa19-b5f1-40e2-80ec-c275e0721a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Flow 'volume_create_manager' (de9c196c-0b08-473a-bffb-d6f47c089872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:12 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e87e468b-71df-42cc-a63f-05309e532293 tempest-TestInstancesWithCinderVolumes-1017353710 None] Created volume successfully. Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Flow 'volume_create_manager' (512e478e-5435-4489-aff1-9059f6f60641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f745d2-55fb-4090-876c-12574caae464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f745d2-55fb-4090-876c-12574caae464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-92586967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d658afb-b21c-410a-9697-27d2be2fae62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e88b70acc8c46608ffbea5cd2d8bc6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:13Z,use_quota=True,user_id='88c36c3d89e74c248ca35f7988539b35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39215e35-9abb-42c6-af46-e85fcbfaa34c),volume_type_id=39215e35-9abb-42c6-af46-e85fcbfaa34c)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e46255-912f-4282-9651-5591f0b355ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e46255-912f-4282-9651-5591f0b355ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77ab34c-4879-449d-ac04-3ed77f7e4cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:12 devstack cinder-volume[87568]: DEBUG cinder.image.glance [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Creating Keystone auth plugin from conf {{(pid=87568) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 12:20:13 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d62eb484-642b-4dd4-8086-94bba1a93b9e 1073741824" returned: 0 in 0.938s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d62eb484-642b-4dd4-8086-94bba1a93b9e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:13 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d62eb484-642b-4dd4-8086-94bba1a93b9e Jul 22 12:20:13 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:14 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d62eb484-642b-4dd4-8086-94bba1a93b9e" returned: 0 in 0.525s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:20:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77ab34c-4879-449d-ac04-3ed77f7e4cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4d658afb-b21c-410a-9697-27d2be2fae62', 'volume_name': 'volume-4d658afb-b21c-410a-9697-27d2be2fae62', 'volume_size': 1, 'image_id': '0fc28fc2-bc3b-4a5d-b909-277521476ba5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fc28fc2-bc3b-4a5d-b909-277521476ba5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2097434929', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9e88b70acc8c46608ffbea5cd2d8bc6a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fc28fc2-bc3b-4a5d-b909-277521476ba5', 'created_at': datetime.datetime(2026, 7, 22, 10, 20, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 20, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fc28fc2-bc3b-4a5d-b909-277521476ba5/file', 'properties': {}}, 'image_service': }' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dda1d60-cb64-45f8-a035-4f33994e79d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dda1d60-cb64-45f8-a035-4f33994e79d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d79c1a-e63b-47cc-8a5c-07bdccb24fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:14 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Volume 4d658afb-b21c-410a-9697-27d2be2fae62: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4d658afb-b21c-410a-9697-27d2be2fae62', 'volume_size': 1, 'image_id': '0fc28fc2-bc3b-4a5d-b909-277521476ba5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fc28fc2-bc3b-4a5d-b909-277521476ba5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2097434929', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9e88b70acc8c46608ffbea5cd2d8bc6a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fc28fc2-bc3b-4a5d-b909-277521476ba5', 'created_at': datetime.datetime(2026, 7, 22, 10, 20, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 20, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fc28fc2-bc3b-4a5d-b909-277521476ba5/file', 'properties': {}}, 'image_service': } Jul 22 12:20:14 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Trying to clone 4d658afb-b21c-410a-9697-27d2be2fae62 from image 0fc28fc2-bc3b-4a5d-b909-277521476ba5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0fc28fc2-bc3b-4a5d-b909-277521476ba5', 'metadata': {}}]). {{(pid=87568) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 12:20:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc7c3ab-5d38-47e8-bb6f-339ad5b3554d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d62eb484-642b-4dd4-8086-94bba1a93b9e', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e00bb49-046d-4c08-a3a5-5c3b04b5d1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:14 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Volume volume-d62eb484-642b-4dd4-8086-94bba1a93b9e (d62eb484-642b-4dd4-8086-94bba1a93b9e): created successfully Jul 22 12:20:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e00bb49-046d-4c08-a3a5-5c3b04b5d1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Flow 'volume_create_manager' (dd13c988-2725-4529-8b59-1d558d587a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:14 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-250685a7-817e-4636-998c-b708c02811ca tempest-TestInstancesWithCinderVolumes-1017353710 None] Created volume successfully. Jul 22 12:20:15 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-319f93a4-6f76-4624-8412-72c3819fa43d req-ab0ea775-4f39-458c-bb3b-98b279c0ff01 tempest-TestShelveInstance-1552906758 None] Terminate volume connection completed successfully. Jul 22 12:20:15 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-319f93a4-6f76-4624-8412-72c3819fa43d req-ab0ea775-4f39-458c-bb3b-98b279c0ff01 tempest-TestShelveInstance-1552906758 None] Deleting attachment 8913388e-053a-4f46-82ff-51f8531b90ce. {{(pid=87568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 12:20:15 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-319f93a4-6f76-4624-8412-72c3819fa43d req-4fa3ba0e-7cf5-4cbf-962c-28a290a2c06a tempest-TestShelveInstance-1552906758 None] Acquiring lock "cinder-1b262626-0dbe-4fb5-853e-06bac1abac7e-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:20:15 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-319f93a4-6f76-4624-8412-72c3819fa43d req-4fa3ba0e-7cf5-4cbf-962c-28a290a2c06a tempest-TestShelveInstance-1552906758 None] Lock "cinder-1b262626-0dbe-4fb5-853e-06bac1abac7e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:20:15 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-319f93a4-6f76-4624-8412-72c3819fa43d req-4fa3ba0e-7cf5-4cbf-962c-28a290a2c06a tempest-TestShelveInstance-1552906758 None] Acquiring lock "cinder-quobyte-1b262626-0dbe-4fb5-853e-06bac1abac7e" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:20:15 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-319f93a4-6f76-4624-8412-72c3819fa43d req-4fa3ba0e-7cf5-4cbf-962c-28a290a2c06a tempest-TestShelveInstance-1552906758 None] Lock "cinder-quobyte-1b262626-0dbe-4fb5-853e-06bac1abac7e" acquired by "delete_volume" :: waited 0.023s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:20:15 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[75905c30-efce-4bd2-a182-a925c6b14030]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:20:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-319f93a4-6f76-4624-8412-72c3819fa43d req-4fa3ba0e-7cf5-4cbf-962c-28a290a2c06a tempest-TestShelveInstance-1552906758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1b262626-0dbe-4fb5-853e-06bac1abac7e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:15 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1b262626-0dbe-4fb5-853e-06bac1abac7e Jul 22 12:20:15 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:16 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-319f93a4-6f76-4624-8412-72c3819fa43d req-4fa3ba0e-7cf5-4cbf-962c-28a290a2c06a tempest-TestShelveInstance-1552906758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1b262626-0dbe-4fb5-853e-06bac1abac7e" returned: 0 in 0.533s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-319f93a4-6f76-4624-8412-72c3819fa43d req-4fa3ba0e-7cf5-4cbf-962c-28a290a2c06a tempest-TestShelveInstance-1552906758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1b262626-0dbe-4fb5-853e-06bac1abac7e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:16 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1b262626-0dbe-4fb5-853e-06bac1abac7e Jul 22 12:20:16 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:16 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Flow 'volume_create_manager' (e8de37d7-524e-4fcd-9383-e0555114cfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf94f3c1-2078-412f-a7d0-401842eb5f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-319f93a4-6f76-4624-8412-72c3819fa43d req-4fa3ba0e-7cf5-4cbf-962c-28a290a2c06a tempest-TestShelveInstance-1552906758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1b262626-0dbe-4fb5-853e-06bac1abac7e" returned: 0 in 0.368s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf94f3c1-2078-412f-a7d0-401842eb5f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1597702191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72bbfb10-abfb-41a5-a95e-715e61fb8f86,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef252defe1604545a1c3daeb93a58a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:16Z,use_quota=True,user_id='0545af5181fc45fbbbf13c94ee7dd9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080a0738-8ad3-4ca8-ac1f-ed93209a537f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080a0738-8ad3-4ca8-ac1f-ed93209a537f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fce65bba-bf6e-4a79-a357-d05ae52f3c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fce65bba-bf6e-4a79-a357-d05ae52f3c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72bbfb10-abfb-41a5-a95e-715e61fb8f86', 'volume_name': 'volume-72bbfb10-abfb-41a5-a95e-715e61fb8f86', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbfb4c17-e329-4b13-95d2-1065216fe146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbfb4c17-e329-4b13-95d2-1065216fe146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (393e3166-38ce-487f-9164-85a0ef848d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:16 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Volume 72bbfb10-abfb-41a5-a95e-715e61fb8f86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72bbfb10-abfb-41a5-a95e-715e61fb8f86', 'volume_size': 1} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1597702191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72bbfb10-abfb-41a5-a95e-715e61fb8f86,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef252defe1604545a1c3daeb93a58a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:16Z,use_quota=True,user_id='0545af5181fc45fbbbf13c94ee7dd9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Creating volume 72bbfb10-abfb-41a5-a95e-715e61fb8f86 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:20:16 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-72bbfb10-abfb-41a5-a95e-715e61fb8f86 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-319f93a4-6f76-4624-8412-72c3819fa43d req-4fa3ba0e-7cf5-4cbf-962c-28a290a2c06a tempest-TestShelveInstance-1552906758 None] Lock "cinder-quobyte-1b262626-0dbe-4fb5-853e-06bac1abac7e" released by "delete_volume" :: held 1.041s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:20:16 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-72bbfb10-abfb-41a5-a95e-715e61fb8f86 1073741824 Jul 22 12:20:16 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG cinder.quota [req-319f93a4-6f76-4624-8412-72c3819fa43d req-4fa3ba0e-7cf5-4cbf-962c-28a290a2c06a tempest-TestShelveInstance-1552906758 None] Created reservations ['a685479b-e484-49e0-89b6-865e3bd35e8b', '8496edb2-0dbe-4e27-a351-891d70b797a6', 'ad985519-efb9-404f-b00f-3d5c605fc7d5', '4cfbb124-5918-452a-8507-d7a403331319'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-319f93a4-6f76-4624-8412-72c3819fa43d req-4fa3ba0e-7cf5-4cbf-962c-28a290a2c06a tempest-TestShelveInstance-1552906758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-319f93a4-6f76-4624-8412-72c3819fa43d req-4fa3ba0e-7cf5-4cbf-962c-28a290a2c06a tempest-TestShelveInstance-1552906758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [req-319f93a4-6f76-4624-8412-72c3819fa43d req-4fa3ba0e-7cf5-4cbf-962c-28a290a2c06a tempest-TestShelveInstance-1552906758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [req-319f93a4-6f76-4624-8412-72c3819fa43d req-4fa3ba0e-7cf5-4cbf-962c-28a290a2c06a tempest-TestShelveInstance-1552906758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-319f93a4-6f76-4624-8412-72c3819fa43d req-4fa3ba0e-7cf5-4cbf-962c-28a290a2c06a tempest-TestShelveInstance-1552906758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-319f93a4-6f76-4624-8412-72c3819fa43d req-4fa3ba0e-7cf5-4cbf-962c-28a290a2c06a tempest-TestShelveInstance-1552906758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:17 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:20:17 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:17 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-72bbfb10-abfb-41a5-a95e-715e61fb8f86 1073741824" returned: 0 in 0.746s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:17 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-319f93a4-6f76-4624-8412-72c3819fa43d req-4fa3ba0e-7cf5-4cbf-962c-28a290a2c06a tempest-TestShelveInstance-1552906758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.496s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:17 devstack cinder-volume[87568]: DEBUG cinder.manager [req-319f93a4-6f76-4624-8412-72c3819fa43d req-4fa3ba0e-7cf5-4cbf-962c-28a290a2c06a tempest-TestShelveInstance-1552906758 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:20:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-72bbfb10-abfb-41a5-a95e-715e61fb8f86 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:17 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-319f93a4-6f76-4624-8412-72c3819fa43d req-4fa3ba0e-7cf5-4cbf-962c-28a290a2c06a tempest-TestShelveInstance-1552906758 None] Deleted volume successfully. Jul 22 12:20:17 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-72bbfb10-abfb-41a5-a95e-715e61fb8f86 Jul 22 12:20:17 devstack cinder-volume[87568]: DEBUG cinder.coordination [req-319f93a4-6f76-4624-8412-72c3819fa43d req-4fa3ba0e-7cf5-4cbf-962c-28a290a2c06a tempest-TestShelveInstance-1552906758 None] Lock "cinder-1b262626-0dbe-4fb5-853e-06bac1abac7e-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:20:17 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:17 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-72bbfb10-abfb-41a5-a95e-715e61fb8f86" returned: 0 in 0.327s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:20:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (393e3166-38ce-487f-9164-85a0ef848d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72bbfb10-abfb-41a5-a95e-715e61fb8f86', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771fcc22-d895-4735-a8d5-604db488cd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:17 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Volume volume-72bbfb10-abfb-41a5-a95e-715e61fb8f86 (72bbfb10-abfb-41a5-a95e-715e61fb8f86): created successfully Jul 22 12:20:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771fcc22-d895-4735-a8d5-604db488cd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Flow 'volume_create_manager' (e8de37d7-524e-4fcd-9383-e0555114cfd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:17 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d64cb31a-9c32-4321-8998-a63946b2cb70 tempest-VolumesListTestJSON-2065535241 None] Created volume successfully. Jul 22 12:20:19 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:20:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Flow 'volume_create_manager' (3baaabf2-17a6-4476-bfdd-79cfa99b144c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee78d40-f996-45eb-a92d-02d4c262d4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee78d40-f996-45eb-a92d-02d4c262d4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-590029888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc08724b-7845-457e-bf8a-31fd56946053,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef252defe1604545a1c3daeb93a58a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:19Z,use_quota=True,user_id='0545af5181fc45fbbbf13c94ee7dd9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a63fba-62a7-4070-980e-fd62acb00c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a63fba-62a7-4070-980e-fd62acb00c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fbb33d9-7367-4493-85cb-79f490d2f7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fbb33d9-7367-4493-85cb-79f490d2f7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc08724b-7845-457e-bf8a-31fd56946053', 'volume_name': 'volume-cc08724b-7845-457e-bf8a-31fd56946053', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647328a7-2892-4fad-87da-47932cb6e2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647328a7-2892-4fad-87da-47932cb6e2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa6651b-e592-4159-a42d-faf34dd66ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:19 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Volume cc08724b-7845-457e-bf8a-31fd56946053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc08724b-7845-457e-bf8a-31fd56946053', 'volume_size': 1} Jul 22 12:20:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-590029888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc08724b-7845-457e-bf8a-31fd56946053,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef252defe1604545a1c3daeb93a58a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:19Z,use_quota=True,user_id='0545af5181fc45fbbbf13c94ee7dd9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:20:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Creating volume cc08724b-7845-457e-bf8a-31fd56946053 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:20:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:20:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:20:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:20:19 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:20:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc08724b-7845-457e-bf8a-31fd56946053 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:19 devstack sudo[99876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc08724b-7845-457e-bf8a-31fd56946053 1073741824 Jul 22 12:20:19 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:20 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc08724b-7845-457e-bf8a-31fd56946053 1073741824" returned: 0 in 0.847s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc08724b-7845-457e-bf8a-31fd56946053 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:20 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0fc28fc2-bc3b-4a5d-b909-277521476ba5_qvk4ttgodevstack@QuobyteHD, size 20.69 MB, duration 6.24 sec {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 12:20:20 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Image download 20.69 MB at 3.31 MB/s Jul 22 12:20:20 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc08724b-7845-457e-bf8a-31fd56946053 Jul 22 12:20:20 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:20 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b91a0f7-6ed0-4446-acd5-45428dac8d1e]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:20:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fc28fc2-bc3b-4a5d-b909-277521476ba5_qvk4ttgodevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:20 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fc28fc2-bc3b-4a5d-b909-277521476ba5_qvk4ttgodevstack@QuobyteHD Jul 22 12:20:20 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:20 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc08724b-7845-457e-bf8a-31fd56946053" returned: 0 in 0.344s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:20 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:20:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa6651b-e592-4159-a42d-faf34dd66ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc08724b-7845-457e-bf8a-31fd56946053', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2df7cf8-c0ba-4b30-bf74-85e58b2ac6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:20 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Volume volume-cc08724b-7845-457e-bf8a-31fd56946053 (cc08724b-7845-457e-bf8a-31fd56946053): created successfully Jul 22 12:20:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2df7cf8-c0ba-4b30-bf74-85e58b2ac6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Flow 'volume_create_manager' (3baaabf2-17a6-4476-bfdd-79cfa99b144c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:20 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-01ac4f64-6b03-4189-bfc9-e19cb3a689e7 tempest-VolumesListTestJSON-2065535241 None] Created volume successfully. Jul 22 12:20:20 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fc28fc2-bc3b-4a5d-b909-277521476ba5_qvk4ttgodevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:20 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Temporary image 0fc28fc2-bc3b-4a5d-b909-277521476ba5 is fetched for user 88c36c3d89e74c248ca35f7988539b35. {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 12:20:21 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[553d83f0-6689-41ba-b03a-a40eaa8e62b2]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:20:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fc28fc2-bc3b-4a5d-b909-277521476ba5_qvk4ttgodevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:21 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fc28fc2-bc3b-4a5d-b909-277521476ba5_qvk4ttgodevstack@QuobyteHD Jul 22 12:20:21 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:21 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fc28fc2-bc3b-4a5d-b909-277521476ba5_qvk4ttgodevstack@QuobyteHD" returned: 0 in 0.522s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-92586967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d658afb-b21c-410a-9697-27d2be2fae62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e88b70acc8c46608ffbea5cd2d8bc6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:13Z,use_quota=True,user_id='88c36c3d89e74c248ca35f7988539b35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39215e35-9abb-42c6-af46-e85fcbfaa34c),volume_type_id=39215e35-9abb-42c6-af46-e85fcbfaa34c)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:20:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Creating volume 4d658afb-b21c-410a-9697-27d2be2fae62 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:20:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:20:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:20:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:20:21 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:20:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d658afb-b21c-410a-9697-27d2be2fae62 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:21 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d658afb-b21c-410a-9697-27d2be2fae62 1073741824 Jul 22 12:20:21 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Flow 'volume_create_manager' (fd0c5bb4-d728-4842-bd73-8e5c3cf4e404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e38df077-ba3a-47c2-8162-b2b1f3c4d644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e38df077-ba3a-47c2-8162-b2b1f3c4d644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1803079083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2bc263-d96f-4a1d-b045-17b5fd5208f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef252defe1604545a1c3daeb93a58a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:22Z,use_quota=True,user_id='0545af5181fc45fbbbf13c94ee7dd9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2310d930-e074-4c38-be1b-7404da34fd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2310d930-e074-4c38-be1b-7404da34fd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54819a9f-965c-4000-a7b5-e50f0bb2ab17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54819a9f-965c-4000-a7b5-e50f0bb2ab17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd2bc263-d96f-4a1d-b045-17b5fd5208f1', 'volume_name': 'volume-fd2bc263-d96f-4a1d-b045-17b5fd5208f1', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bbcd023-a069-4ef3-86d6-1f0cb25c8f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bbcd023-a069-4ef3-86d6-1f0cb25c8f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:22 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17597e69-d968-4e87-b43e-b03faabfb011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:22 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Volume fd2bc263-d96f-4a1d-b045-17b5fd5208f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd2bc263-d96f-4a1d-b045-17b5fd5208f1', 'volume_size': 1} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d658afb-b21c-410a-9697-27d2be2fae62 1073741824" returned: 0 in 0.691s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d658afb-b21c-410a-9697-27d2be2fae62 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:22 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d658afb-b21c-410a-9697-27d2be2fae62 Jul 22 12:20:22 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:22 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d658afb-b21c-410a-9697-27d2be2fae62" returned: 0 in 0.354s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.408s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1803079083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2bc263-d96f-4a1d-b045-17b5fd5208f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef252defe1604545a1c3daeb93a58a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:22Z,use_quota=True,user_id='0545af5181fc45fbbbf13c94ee7dd9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Creating volume fd2bc263-d96f-4a1d-b045-17b5fd5208f1 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:20:22 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fd2bc263-d96f-4a1d-b045-17b5fd5208f1 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:22 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fd2bc263-d96f-4a1d-b045-17b5fd5208f1 1073741824 Jul 22 12:20:22 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Attempting download of 0fc28fc2-bc3b-4a5d-b909-277521476ba5 ((None, [{'url': 'file:///opt/stack/data/glance/images/0fc28fc2-bc3b-4a5d-b909-277521476ba5', 'metadata': {}}])) to volume 4d658afb-b21c-410a-9697-27d2be2fae62. {{(pid=87568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c5a3fb-da06-41f3-a067-3aababbf5718]: (4, 'raw') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:20:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fc28fc2-bc3b-4a5d-b909-277521476ba5_2g99va9k {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:23 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fc28fc2-bc3b-4a5d-b909-277521476ba5_2g99va9k Jul 22 12:20:23 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:23 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fd2bc263-d96f-4a1d-b045-17b5fd5208f1 1073741824" returned: 0 in 0.628s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:23 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fc28fc2-bc3b-4a5d-b909-277521476ba5_2g99va9k" returned: 0 in 0.525s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fc28fc2-bc3b-4a5d-b909-277521476ba5_2g99va9k {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fd2bc263-d96f-4a1d-b045-17b5fd5208f1 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:23 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fd2bc263-d96f-4a1d-b045-17b5fd5208f1 Jul 22 12:20:23 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:23 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fc28fc2-bc3b-4a5d-b909-277521476ba5_2g99va9k Jul 22 12:20:23 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:23 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fd2bc263-d96f-4a1d-b045-17b5fd5208f1" returned: 0 in 0.351s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:20:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17597e69-d968-4e87-b43e-b03faabfb011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd2bc263-d96f-4a1d-b045-17b5fd5208f1', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53c508c-a6a8-40b2-9496-39a5d47e1c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:23 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Volume volume-fd2bc263-d96f-4a1d-b045-17b5fd5208f1 (fd2bc263-d96f-4a1d-b045-17b5fd5208f1): created successfully Jul 22 12:20:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53c508c-a6a8-40b2-9496-39a5d47e1c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Flow 'volume_create_manager' (fd0c5bb4-d728-4842-bd73-8e5c3cf4e404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:23 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-0e50d99b-cbd7-4551-975f-ef9d9dfecd0c tempest-VolumesListTestJSON-2065535241 None] Created volume successfully. Jul 22 12:20:23 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fc28fc2-bc3b-4a5d-b909-277521476ba5_2g99va9k" returned: 1 in 0.460s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fc28fc2-bc3b-4a5d-b909-277521476ba5_2g99va9k' failed. Not Retrying. {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:20:23 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd1b690-ffd7-4d24-b57c-7d04679e240d]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:20:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fc28fc2-bc3b-4a5d-b909-277521476ba5_qvk4ttgodevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:23 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fc28fc2-bc3b-4a5d-b909-277521476ba5_qvk4ttgodevstack@QuobyteHD Jul 22 12:20:23 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:24 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fc28fc2-bc3b-4a5d-b909-277521476ba5_qvk4ttgodevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:24 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] 0fc28fc2-bc3b-4a5d-b909-277521476ba5 was qcow2, converting to qcow2 {{(pid=87568) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 12:20:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fc28fc2-bc3b-4a5d-b909-277521476ba5_qvk4ttgodevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d658afb-b21c-410a-9697-27d2be2fae62 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:24 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fc28fc2-bc3b-4a5d-b909-277521476ba5_qvk4ttgodevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d658afb-b21c-410a-9697-27d2be2fae62 Jul 22 12:20:24 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:20:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:20:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:20:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:24 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:20:24 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:24 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.405s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:24 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:20:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:20:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread count: 28 {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:20:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread info: [<_MainThread(MainThread, started 137793405739136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:20:26 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fc28fc2-bc3b-4a5d-b909-277521476ba5_qvk4ttgodevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d658afb-b21c-410a-9697-27d2be2fae62" returned: 0 in 2.557s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:26 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0fc28fc2-bc3b-4a5d-b909-277521476ba5_qvk4ttgodevstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d658afb-b21c-410a-9697-27d2be2fae62 {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:20:26 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Converted 112.00 MB image at 43.79 MB/s Jul 22 12:20:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d658afb-b21c-410a-9697-27d2be2fae62 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:26 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d658afb-b21c-410a-9697-27d2be2fae62 1G Jul 22 12:20:26 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6b026f8d-a728-4479-adde-9d4c973689c4 tempest-VolumesListTestJSON-2065535241 None] Acquiring lock "cinder-fd2bc263-d96f-4a1d-b045-17b5fd5208f1-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:20:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6b026f8d-a728-4479-adde-9d4c973689c4 tempest-VolumesListTestJSON-2065535241 None] Lock "cinder-fd2bc263-d96f-4a1d-b045-17b5fd5208f1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:20:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6b026f8d-a728-4479-adde-9d4c973689c4 tempest-VolumesListTestJSON-2065535241 None] Acquiring lock "cinder-quobyte-fd2bc263-d96f-4a1d-b045-17b5fd5208f1" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:20:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6b026f8d-a728-4479-adde-9d4c973689c4 tempest-VolumesListTestJSON-2065535241 None] Lock "cinder-quobyte-fd2bc263-d96f-4a1d-b045-17b5fd5208f1" acquired by "delete_volume" :: waited 0.023s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:20:27 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f6f730-35bf-45bf-a3c1-42aa90cb413c]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:20:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6b026f8d-a728-4479-adde-9d4c973689c4 tempest-VolumesListTestJSON-2065535241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fd2bc263-d96f-4a1d-b045-17b5fd5208f1 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:27 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d658afb-b21c-410a-9697-27d2be2fae62 1G" returned: 0 in 0.519s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:27 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Downloaded image 0fc28fc2-bc3b-4a5d-b909-277521476ba5 ((None, [{'url': 'file:///opt/stack/data/glance/images/0fc28fc2-bc3b-4a5d-b909-277521476ba5', 'metadata': {}}])) to volume 4d658afb-b21c-410a-9697-27d2be2fae62 successfully. {{(pid=87568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 12:20:27 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Temporary image 0fc28fc2-bc3b-4a5d-b909-277521476ba5 for user 88c36c3d89e74c248ca35f7988539b35 is deleted. {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 12:20:27 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Marking volume 4d658afb-b21c-410a-9697-27d2be2fae62 as bootable. {{(pid=87568) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 12:20:27 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Copying metadata from image 0fc28fc2-bc3b-4a5d-b909-277521476ba5 to 4d658afb-b21c-410a-9697-27d2be2fae62. {{(pid=87568) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 12:20:27 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Creating volume glance metadata for volume 4d658afb-b21c-410a-9697-27d2be2fae62 backed by image 0fc28fc2-bc3b-4a5d-b909-277521476ba5 with: {'image_id': '0fc28fc2-bc3b-4a5d-b909-277521476ba5', 'image_name': 'tempest-scenario-img--2097434929', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87568) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 12:20:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d79c1a-e63b-47cc-8a5c-07bdccb24fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d658afb-b21c-410a-9697-27d2be2fae62', 'volume_size': 1, 'image_id': '0fc28fc2-bc3b-4a5d-b909-277521476ba5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fc28fc2-bc3b-4a5d-b909-277521476ba5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2097434929', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9e88b70acc8c46608ffbea5cd2d8bc6a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fc28fc2-bc3b-4a5d-b909-277521476ba5', 'created_at': datetime.datetime(2026, 7, 22, 10, 20, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 20, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fc28fc2-bc3b-4a5d-b909-277521476ba5/file', 'properties': {}}, 'image_service': }' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6392e63e-7251-44b9-9089-967eb087e6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:27 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fd2bc263-d96f-4a1d-b045-17b5fd5208f1 Jul 22 12:20:27 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:27 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Volume volume-4d658afb-b21c-410a-9697-27d2be2fae62 (4d658afb-b21c-410a-9697-27d2be2fae62): created successfully Jul 22 12:20:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6392e63e-7251-44b9-9089-967eb087e6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Flow 'volume_create_manager' (512e478e-5435-4489-aff1-9059f6f60641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:27 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-9caa96f0-12a3-40be-b3cb-4c005b00e78e tempest-TestInstancesWithCinderVolumes-1017353710 None] Created volume successfully. Jul 22 12:20:27 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6b026f8d-a728-4479-adde-9d4c973689c4 tempest-VolumesListTestJSON-2065535241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fd2bc263-d96f-4a1d-b045-17b5fd5208f1" returned: 0 in 0.524s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6b026f8d-a728-4479-adde-9d4c973689c4 tempest-VolumesListTestJSON-2065535241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fd2bc263-d96f-4a1d-b045-17b5fd5208f1 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:27 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fd2bc263-d96f-4a1d-b045-17b5fd5208f1 Jul 22 12:20:27 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:28 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6b026f8d-a728-4479-adde-9d4c973689c4 tempest-VolumesListTestJSON-2065535241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fd2bc263-d96f-4a1d-b045-17b5fd5208f1" returned: 0 in 0.496s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6b026f8d-a728-4479-adde-9d4c973689c4 tempest-VolumesListTestJSON-2065535241 None] Lock "cinder-quobyte-fd2bc263-d96f-4a1d-b045-17b5fd5208f1" released by "delete_volume" :: held 1.087s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:20:28 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-6b026f8d-a728-4479-adde-9d4c973689c4 tempest-VolumesListTestJSON-2065535241 None] Created reservations ['b31cf7e7-d0d5-4c03-bfd2-44d4437ead1b', 'b35b2dd6-3516-4f2b-b02a-b157b7cff622', '59763137-0d24-47e6-a471-268561d32ae3', 'd4917648-fa99-4131-884a-51975cab0809'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:20:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6b026f8d-a728-4479-adde-9d4c973689c4 tempest-VolumesListTestJSON-2065535241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6b026f8d-a728-4479-adde-9d4c973689c4 tempest-VolumesListTestJSON-2065535241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6b026f8d-a728-4479-adde-9d4c973689c4 tempest-VolumesListTestJSON-2065535241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:20:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6b026f8d-a728-4479-adde-9d4c973689c4 tempest-VolumesListTestJSON-2065535241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:20:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6b026f8d-a728-4479-adde-9d4c973689c4 tempest-VolumesListTestJSON-2065535241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6b026f8d-a728-4479-adde-9d4c973689c4 tempest-VolumesListTestJSON-2065535241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:28 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:20:28 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:28 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6b026f8d-a728-4479-adde-9d4c973689c4 tempest-VolumesListTestJSON-2065535241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.338s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:28 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-6b026f8d-a728-4479-adde-9d4c973689c4 tempest-VolumesListTestJSON-2065535241 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:20:28 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-6b026f8d-a728-4479-adde-9d4c973689c4 tempest-VolumesListTestJSON-2065535241 None] Deleted volume successfully. Jul 22 12:20:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6b026f8d-a728-4479-adde-9d4c973689c4 tempest-VolumesListTestJSON-2065535241 None] Lock "cinder-fd2bc263-d96f-4a1d-b045-17b5fd5208f1-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:20:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6ea83cba-00ac-40c4-9c27-cd5af08cb4d5 tempest-VolumesListTestJSON-2065535241 None] Acquiring lock "cinder-cc08724b-7845-457e-bf8a-31fd56946053-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:20:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6ea83cba-00ac-40c4-9c27-cd5af08cb4d5 tempest-VolumesListTestJSON-2065535241 None] Lock "cinder-cc08724b-7845-457e-bf8a-31fd56946053-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:20:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6ea83cba-00ac-40c4-9c27-cd5af08cb4d5 tempest-VolumesListTestJSON-2065535241 None] Acquiring lock "cinder-quobyte-cc08724b-7845-457e-bf8a-31fd56946053" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:20:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6ea83cba-00ac-40c4-9c27-cd5af08cb4d5 tempest-VolumesListTestJSON-2065535241 None] Lock "cinder-quobyte-cc08724b-7845-457e-bf8a-31fd56946053" acquired by "delete_volume" :: waited 0.020s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:20:29 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8ba072-feb7-4ba1-bf98-ba2ae7de9339]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:20:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6ea83cba-00ac-40c4-9c27-cd5af08cb4d5 tempest-VolumesListTestJSON-2065535241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc08724b-7845-457e-bf8a-31fd56946053 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:29 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc08724b-7845-457e-bf8a-31fd56946053 Jul 22 12:20:29 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:30 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6ea83cba-00ac-40c4-9c27-cd5af08cb4d5 tempest-VolumesListTestJSON-2065535241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc08724b-7845-457e-bf8a-31fd56946053" returned: 0 in 0.459s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6ea83cba-00ac-40c4-9c27-cd5af08cb4d5 tempest-VolumesListTestJSON-2065535241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc08724b-7845-457e-bf8a-31fd56946053 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:30 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc08724b-7845-457e-bf8a-31fd56946053 Jul 22 12:20:30 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:30 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6ea83cba-00ac-40c4-9c27-cd5af08cb4d5 tempest-VolumesListTestJSON-2065535241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cc08724b-7845-457e-bf8a-31fd56946053" returned: 0 in 0.313s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6ea83cba-00ac-40c4-9c27-cd5af08cb4d5 tempest-VolumesListTestJSON-2065535241 None] Lock "cinder-quobyte-cc08724b-7845-457e-bf8a-31fd56946053" released by "delete_volume" :: held 0.831s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:20:30 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-6ea83cba-00ac-40c4-9c27-cd5af08cb4d5 tempest-VolumesListTestJSON-2065535241 None] Created reservations ['26c20f8b-a1c7-4b0f-879e-6592b6066fc8', '31e8ddc3-819e-4b77-a960-6c34bb6dd411', '83d39ef6-74ac-4d29-8c72-74f8332520b6', 'aac562bd-070c-4ae9-8be8-779c7a65a194'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:20:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6ea83cba-00ac-40c4-9c27-cd5af08cb4d5 tempest-VolumesListTestJSON-2065535241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6ea83cba-00ac-40c4-9c27-cd5af08cb4d5 tempest-VolumesListTestJSON-2065535241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6ea83cba-00ac-40c4-9c27-cd5af08cb4d5 tempest-VolumesListTestJSON-2065535241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:20:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6ea83cba-00ac-40c4-9c27-cd5af08cb4d5 tempest-VolumesListTestJSON-2065535241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:20:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6ea83cba-00ac-40c4-9c27-cd5af08cb4d5 tempest-VolumesListTestJSON-2065535241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6ea83cba-00ac-40c4-9c27-cd5af08cb4d5 tempest-VolumesListTestJSON-2065535241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:30 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:20:30 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b0f5b230-8345-45a9-81b7-4d74f2b6e725 tempest-VolumesListTestJSON-2065535241 None] Acquiring lock "cinder-72bbfb10-abfb-41a5-a95e-715e61fb8f86-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:20:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b0f5b230-8345-45a9-81b7-4d74f2b6e725 tempest-VolumesListTestJSON-2065535241 None] Lock "cinder-72bbfb10-abfb-41a5-a95e-715e61fb8f86-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:20:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b0f5b230-8345-45a9-81b7-4d74f2b6e725 tempest-VolumesListTestJSON-2065535241 None] Acquiring lock "cinder-quobyte-72bbfb10-abfb-41a5-a95e-715e61fb8f86" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:20:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b0f5b230-8345-45a9-81b7-4d74f2b6e725 tempest-VolumesListTestJSON-2065535241 None] Lock "cinder-quobyte-72bbfb10-abfb-41a5-a95e-715e61fb8f86" acquired by "delete_volume" :: waited 0.044s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:20:31 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82aa918-e044-4949-96eb-dfde25a8f86b]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:20:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b0f5b230-8345-45a9-81b7-4d74f2b6e725 tempest-VolumesListTestJSON-2065535241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-72bbfb10-abfb-41a5-a95e-715e61fb8f86 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:31 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6ea83cba-00ac-40c4-9c27-cd5af08cb4d5 tempest-VolumesListTestJSON-2065535241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.457s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:31 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-6ea83cba-00ac-40c4-9c27-cd5af08cb4d5 tempest-VolumesListTestJSON-2065535241 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:20:31 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-6ea83cba-00ac-40c4-9c27-cd5af08cb4d5 tempest-VolumesListTestJSON-2065535241 None] Deleted volume successfully. Jul 22 12:20:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6ea83cba-00ac-40c4-9c27-cd5af08cb4d5 tempest-VolumesListTestJSON-2065535241 None] Lock "cinder-cc08724b-7845-457e-bf8a-31fd56946053-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:20:31 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-72bbfb10-abfb-41a5-a95e-715e61fb8f86 Jul 22 12:20:31 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:31 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b0f5b230-8345-45a9-81b7-4d74f2b6e725 tempest-VolumesListTestJSON-2065535241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-72bbfb10-abfb-41a5-a95e-715e61fb8f86" returned: 0 in 0.512s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b0f5b230-8345-45a9-81b7-4d74f2b6e725 tempest-VolumesListTestJSON-2065535241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-72bbfb10-abfb-41a5-a95e-715e61fb8f86 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:31 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-72bbfb10-abfb-41a5-a95e-715e61fb8f86 Jul 22 12:20:31 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:32 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b0f5b230-8345-45a9-81b7-4d74f2b6e725 tempest-VolumesListTestJSON-2065535241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-72bbfb10-abfb-41a5-a95e-715e61fb8f86" returned: 0 in 0.346s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b0f5b230-8345-45a9-81b7-4d74f2b6e725 tempest-VolumesListTestJSON-2065535241 None] Lock "cinder-quobyte-72bbfb10-abfb-41a5-a95e-715e61fb8f86" released by "delete_volume" :: held 0.935s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:20:32 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-b0f5b230-8345-45a9-81b7-4d74f2b6e725 tempest-VolumesListTestJSON-2065535241 None] Created reservations ['1bcf762d-3fa6-4360-9ef6-2929b0ad01a7', 'f5a0b2cc-eea0-41df-ac0c-e9069693430f', 'a0cac25f-ba14-4757-952b-06daa367215b', '5b79a318-af83-4528-b4d0-0d05bbe91a98'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:20:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b0f5b230-8345-45a9-81b7-4d74f2b6e725 tempest-VolumesListTestJSON-2065535241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b0f5b230-8345-45a9-81b7-4d74f2b6e725 tempest-VolumesListTestJSON-2065535241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b0f5b230-8345-45a9-81b7-4d74f2b6e725 tempest-VolumesListTestJSON-2065535241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:20:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b0f5b230-8345-45a9-81b7-4d74f2b6e725 tempest-VolumesListTestJSON-2065535241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:20:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b0f5b230-8345-45a9-81b7-4d74f2b6e725 tempest-VolumesListTestJSON-2065535241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b0f5b230-8345-45a9-81b7-4d74f2b6e725 tempest-VolumesListTestJSON-2065535241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:32 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:20:32 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:32 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b0f5b230-8345-45a9-81b7-4d74f2b6e725 tempest-VolumesListTestJSON-2065535241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.422s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:32 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-b0f5b230-8345-45a9-81b7-4d74f2b6e725 tempest-VolumesListTestJSON-2065535241 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:20:32 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b0f5b230-8345-45a9-81b7-4d74f2b6e725 tempest-VolumesListTestJSON-2065535241 None] Deleted volume successfully. Jul 22 12:20:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b0f5b230-8345-45a9-81b7-4d74f2b6e725 tempest-VolumesListTestJSON-2065535241 None] Lock "cinder-72bbfb10-abfb-41a5-a95e-715e61fb8f86-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:20:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-7d9e34ca-b5dd-4a83-8d2b-779d91980f9c req-462abc4e-8659-413a-8778-7db56d520a2c tempest-TestInstancesWithCinderVolumes-1017353710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-7d9e34ca-b5dd-4a83-8d2b-779d91980f9c req-462abc4e-8659-413a-8778-7db56d520a2c tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-7d9e34ca-b5dd-4a83-8d2b-779d91980f9c req-462abc4e-8659-413a-8778-7db56d520a2c tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:33 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-7d9e34ca-b5dd-4a83-8d2b-779d91980f9c req-462abc4e-8659-413a-8778-7db56d520a2c tempest-TestInstancesWithCinderVolumes-1017353710 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29', 'name': 'volume-4d658afb-b21c-410a-9697-27d2be2fae62', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '284716a4-83b7-471d-a2ce-f6a72f9ccb85', 'enforce_multipath': True} {{(pid=87568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 12:20:33 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-7d9e34ca-b5dd-4a83-8d2b-779d91980f9c req-462abc4e-8659-413a-8778-7db56d520a2c tempest-TestInstancesWithCinderVolumes-1017353710 None] attachment_update completed successfully. Jul 22 12:20:40 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:20:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Flow 'volume_create_manager' (b80ce84e-9536-4067-964d-b900be2c9db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483c30fa-3dcf-4542-b8e6-354b8ceaf566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483c30fa-3dcf-4542-b8e6-354b8ceaf566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1459017924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa69748f-58d0-4623-bf4b-4523c6964c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2f9aaf299614cf3bb794e3cd74bfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:40Z,use_quota=True,user_id='77fda94bbbe4446eb8f2c152489e86d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc22008-5cb8-4e9a-9244-eb5235e9f67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc22008-5cb8-4e9a-9244-eb5235e9f67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7e04d9-e4b4-4ac9-b845-6962cdf2fd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7e04d9-e4b4-4ac9-b845-6962cdf2fd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa69748f-58d0-4623-bf4b-4523c6964c32', 'volume_name': 'volume-aa69748f-58d0-4623-bf4b-4523c6964c32', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23f3156-1d42-4e4a-8208-ec92a0a4072d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23f3156-1d42-4e4a-8208-ec92a0a4072d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6d8221-5d23-4b35-bb44-50d92f78998a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:40 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Volume aa69748f-58d0-4623-bf4b-4523c6964c32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa69748f-58d0-4623-bf4b-4523c6964c32', 'volume_size': 1} Jul 22 12:20:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1459017924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa69748f-58d0-4623-bf4b-4523c6964c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2f9aaf299614cf3bb794e3cd74bfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:40Z,use_quota=True,user_id='77fda94bbbe4446eb8f2c152489e86d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:20:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Creating volume aa69748f-58d0-4623-bf4b-4523c6964c32 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:20:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:20:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:20:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:20:40 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:20:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:40 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32 1073741824 Jul 22 12:20:40 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:40 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32 1073741824" returned: 0 in 0.795s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:41 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32 Jul 22 12:20:41 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:41 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32" returned: 0 in 0.402s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:20:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6d8221-5d23-4b35-bb44-50d92f78998a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa69748f-58d0-4623-bf4b-4523c6964c32', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c83893-1f1c-42cd-a03d-4ad2c45c9e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:41 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Volume volume-aa69748f-58d0-4623-bf4b-4523c6964c32 (aa69748f-58d0-4623-bf4b-4523c6964c32): created successfully Jul 22 12:20:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c83893-1f1c-42cd-a03d-4ad2c45c9e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Flow 'volume_create_manager' (b80ce84e-9536-4067-964d-b900be2c9db4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:41 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-aafdb2a6-36bc-43be-bf01-052b6ef5690e tempest-CreateVolumesFromSnapshotTest-1448639784 None] Created volume successfully. Jul 22 12:20:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-148c02c6-9913-4475-af67-fe7c9c16a4e8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-148c02c6-9913-4475-af67-fe7c9c16a4e8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-148c02c6-9913-4475-af67-fe7c9c16a4e8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Creating offline snapshot 0e17ad65-39ce-4d77-a06b-9c6557bcf532 of volume aa69748f-58d0-4623-bf4b-4523c6964c32 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:20:42 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[31409572-c775-4978-bc8d-b0346b888d86]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:20:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-148c02c6-9913-4475-af67-fe7c9c16a4e8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:43 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32 Jul 22 12:20:43 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:43 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-148c02c6-9913-4475-af67-fe7c9c16a4e8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32" returned: 0 in 0.851s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-148c02c6-9913-4475-af67-fe7c9c16a4e8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.0e17ad65-39ce-4d77-a06b-9c6557bcf532 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:43 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.0e17ad65-39ce-4d77-a06b-9c6557bcf532 1G Jul 22 12:20:43 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:44 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-148c02c6-9913-4475-af67-fe7c9c16a4e8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.0e17ad65-39ce-4d77-a06b-9c6557bcf532 1G" returned: 0 in 0.774s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-148c02c6-9913-4475-af67-fe7c9c16a4e8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa69748f-58d0-4623-bf4b-4523c6964c32 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.0e17ad65-39ce-4d77-a06b-9c6557bcf532 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:44 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa69748f-58d0-4623-bf4b-4523c6964c32 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.0e17ad65-39ce-4d77-a06b-9c6557bcf532 Jul 22 12:20:44 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:44 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-148c02c6-9913-4475-af67-fe7c9c16a4e8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa69748f-58d0-4623-bf4b-4523c6964c32 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.0e17ad65-39ce-4d77-a06b-9c6557bcf532" returned: 0 in 0.579s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:44 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-148c02c6-9913-4475-af67-fe7c9c16a4e8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.0e17ad65-39ce-4d77-a06b-9c6557bcf532 is being set with open permissions: ugo+rw Jul 22 12:20:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-148c02c6-9913-4475-af67-fe7c9c16a4e8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.0e17ad65-39ce-4d77-a06b-9c6557bcf532 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:45 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.0e17ad65-39ce-4d77-a06b-9c6557bcf532 Jul 22 12:20:45 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:45 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-148c02c6-9913-4475-af67-fe7c9c16a4e8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.0e17ad65-39ce-4d77-a06b-9c6557bcf532" returned: 0 in 0.472s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-148c02c6-9913-4475-af67-fe7c9c16a4e8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:45 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.info Jul 22 12:20:45 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:46 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-148c02c6-9913-4475-af67-fe7c9c16a4e8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.info" returned: 0 in 0.601s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:46 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-148c02c6-9913-4475-af67-fe7c9c16a4e8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.info is being set with open permissions: ugo+rw Jul 22 12:20:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-148c02c6-9913-4475-af67-fe7c9c16a4e8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:46 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.info Jul 22 12:20:46 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:46 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-148c02c6-9913-4475-af67-fe7c9c16a4e8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.info" returned: 0 in 0.573s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-148c02c6-9913-4475-af67-fe7c9c16a4e8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.043s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:46 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-148c02c6-9913-4475-af67-fe7c9c16a4e8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Create snapshot completed successfully Jul 22 12:20:48 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:20:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Flow 'volume_create_manager' (dceb9df9-71e0-406c-8df9-7f0ef64ea232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70ec767-3b5d-47e4-83bf-b2e8e2f6ac9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70ec767-3b5d-47e4-83bf-b2e8e2f6ac9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-306738491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2f9aaf299614cf3bb794e3cd74bfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:48Z,use_quota=True,user_id='77fda94bbbe4446eb8f2c152489e86d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a73696-5946-40b5-b6b7-6221a7753cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a73696-5946-40b5-b6b7-6221a7753cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f364fce-60c3-49f2-8bf3-fb626e50393e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f364fce-60c3-49f2-8bf3-fb626e50393e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a', 'volume_name': 'volume-f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119cc6a9-cc7c-4c34-b52c-2039297f400d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119cc6a9-cc7c-4c34-b52c-2039297f400d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7729479d-1a37-41f4-81dc-d724ad846916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:48 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Volume f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a', 'volume_size': 1} Jul 22 12:20:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-306738491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2f9aaf299614cf3bb794e3cd74bfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:48Z,use_quota=True,user_id='77fda94bbbe4446eb8f2c152489e86d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:20:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Creating volume f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:20:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:20:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:20:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:20:48 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:20:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:48 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a 1073741824 Jul 22 12:20:48 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:20:49 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Flow 'volume_create_manager' (de2b3eaa-2fab-4c3a-bfb9-95beca584cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3c49501-9721-4e2e-bf50-4ac9abf039c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a 1073741824" returned: 0 in 0.953s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3c49501-9721-4e2e-bf50-4ac9abf039c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1594496208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcb1c17-afa9-4a7e-9642-951c0fa98022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2f9aaf299614cf3bb794e3cd74bfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:49Z,use_quota=True,user_id='77fda94bbbe4446eb8f2c152489e86d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1953a35c-be66-4533-ab6b-ec82a25a8fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1953a35c-be66-4533-ab6b-ec82a25a8fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0352732b-7128-4142-bea8-be37d4e0647b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0352732b-7128-4142-bea8-be37d4e0647b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dcb1c17-afa9-4a7e-9642-951c0fa98022', 'volume_name': 'volume-3dcb1c17-afa9-4a7e-9642-951c0fa98022', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6658ce4f-0ac1-4586-a2f7-fb2c21e0971d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6658ce4f-0ac1-4586-a2f7-fb2c21e0971d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad181d1d-3c17-402b-b4df-03efdfcbf1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:49 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Volume 3dcb1c17-afa9-4a7e-9642-951c0fa98022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dcb1c17-afa9-4a7e-9642-951c0fa98022', 'volume_size': 1} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:49 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a Jul 22 12:20:49 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:49 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a" returned: 0 in 0.402s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.452s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1594496208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcb1c17-afa9-4a7e-9642-951c0fa98022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2f9aaf299614cf3bb794e3cd74bfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:49Z,use_quota=True,user_id='77fda94bbbe4446eb8f2c152489e86d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Creating volume 3dcb1c17-afa9-4a7e-9642-951c0fa98022 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:20:49 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3dcb1c17-afa9-4a7e-9642-951c0fa98022 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:49 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3dcb1c17-afa9-4a7e-9642-951c0fa98022 1073741824 Jul 22 12:20:49 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7729479d-1a37-41f4-81dc-d724ad846916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c550eea8-9e32-489e-910d-5c3ca63be7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:49 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Volume volume-f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a (f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a): created successfully Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c550eea8-9e32-489e-910d-5c3ca63be7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Flow 'volume_create_manager' (dceb9df9-71e0-406c-8df9-7f0ef64ea232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Flow 'volume_create_manager' (4063e96f-511e-4d11-a976-5fbba4eadb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc56371b-7365-44a5-a19b-89d0e23d96d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:49 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-9aa937be-82c2-477a-8409-2f4c5bc3ce0b tempest-CreateVolumesFromSnapshotTest-1448639784 None] Created volume successfully. Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc56371b-7365-44a5-a19b-89d0e23d96d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-694354092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b639d72a-15b4-481a-ae6b-85fa0afbf9b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2f9aaf299614cf3bb794e3cd74bfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:50Z,use_quota=True,user_id='77fda94bbbe4446eb8f2c152489e86d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (881c04a5-9515-4b9b-9cfb-c77ca31639d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (881c04a5-9515-4b9b-9cfb-c77ca31639d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8453452-3302-4909-ac74-a921381a51bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8453452-3302-4909-ac74-a921381a51bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b639d72a-15b4-481a-ae6b-85fa0afbf9b7', 'volume_name': 'volume-b639d72a-15b4-481a-ae6b-85fa0afbf9b7', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b9a2e2-d887-4495-bfd2-79e09a24ddc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b9a2e2-d887-4495-bfd2-79e09a24ddc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4bcced-40ef-4246-a992-c921dfcbed20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:49 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Volume b639d72a-15b4-481a-ae6b-85fa0afbf9b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b639d72a-15b4-481a-ae6b-85fa0afbf9b7', 'volume_size': 1} Jul 22 12:20:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:50 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:20:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Flow 'volume_create_manager' (b4dcf67f-8e0e-4b70-ab14-d6a340633616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96544ecb-efc1-4009-8133-29d36c533608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96544ecb-efc1-4009-8133-29d36c533608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1773502470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=416202f9-65d0-4888-9cf2-4f5827153c0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2f9aaf299614cf3bb794e3cd74bfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:51Z,use_quota=True,user_id='77fda94bbbe4446eb8f2c152489e86d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:50 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca9ebca-58b5-42ff-b23f-2c9844ffaa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca9ebca-58b5-42ff-b23f-2c9844ffaa37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b11113b-45d2-440e-a11c-93bb674248e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b11113b-45d2-440e-a11c-93bb674248e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '416202f9-65d0-4888-9cf2-4f5827153c0a', 'volume_name': 'volume-416202f9-65d0-4888-9cf2-4f5827153c0a', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2742dcf9-1531-46f9-8386-2ce94a395fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2742dcf9-1531-46f9-8386-2ce94a395fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfbf9834-13e3-40de-b959-24550463093d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:50 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Volume 416202f9-65d0-4888-9cf2-4f5827153c0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-416202f9-65d0-4888-9cf2-4f5827153c0a', 'volume_size': 1} Jul 22 12:20:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3dcb1c17-afa9-4a7e-9642-951c0fa98022 1073741824" returned: 0 in 1.234s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3dcb1c17-afa9-4a7e-9642-951c0fa98022 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:51 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3dcb1c17-afa9-4a7e-9642-951c0fa98022 Jul 22 12:20:51 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:51 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3dcb1c17-afa9-4a7e-9642-951c0fa98022" returned: 0 in 0.526s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:20:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.583s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-694354092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b639d72a-15b4-481a-ae6b-85fa0afbf9b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2f9aaf299614cf3bb794e3cd74bfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:50Z,use_quota=True,user_id='77fda94bbbe4446eb8f2c152489e86d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:20:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Creating volume b639d72a-15b4-481a-ae6b-85fa0afbf9b7 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:20:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:20:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:20:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:20:51 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:20:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b639d72a-15b4-481a-ae6b-85fa0afbf9b7 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:51 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b639d72a-15b4-481a-ae6b-85fa0afbf9b7 1073741824 Jul 22 12:20:51 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad181d1d-3c17-402b-b4df-03efdfcbf1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dcb1c17-afa9-4a7e-9642-951c0fa98022', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187606e6-f7e8-4365-af03-2fb03fc815a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:51 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Volume volume-3dcb1c17-afa9-4a7e-9642-951c0fa98022 (3dcb1c17-afa9-4a7e-9642-951c0fa98022): created successfully Jul 22 12:20:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187606e6-f7e8-4365-af03-2fb03fc815a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Flow 'volume_create_manager' (de2b3eaa-2fab-4c3a-bfb9-95beca584cfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:51 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-852193e7-026a-4f30-b33f-683de33bdc2c tempest-CreateVolumesFromSnapshotTest-1448639784 None] Created volume successfully. Jul 22 12:20:52 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:20:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Flow 'volume_create_manager' (d7989e3d-d554-4acc-9c1a-99ea4ca856a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b17128e-2c14-4e64-bc82-e812b8624bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b17128e-2c14-4e64-bc82-e812b8624bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-52380862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed498c4e-9966-4b61-b00a-67af4cf3c6a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2f9aaf299614cf3bb794e3cd74bfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:52Z,use_quota=True,user_id='77fda94bbbe4446eb8f2c152489e86d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785b87a0-fb22-4b64-9987-1bb94de9c72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785b87a0-fb22-4b64-9987-1bb94de9c72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b116e3-9e0d-4c62-a9e3-6f2aeaac63d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b116e3-9e0d-4c62-a9e3-6f2aeaac63d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed498c4e-9966-4b61-b00a-67af4cf3c6a2', 'volume_name': 'volume-ed498c4e-9966-4b61-b00a-67af4cf3c6a2', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d50349d3-0cda-4316-9325-e4902cacf459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d50349d3-0cda-4316-9325-e4902cacf459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4397362f-234c-4373-97ec-ecf375be6243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:52 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Volume ed498c4e-9966-4b61-b00a-67af4cf3c6a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed498c4e-9966-4b61-b00a-67af4cf3c6a2', 'volume_size': 1} Jul 22 12:20:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:52 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b639d72a-15b4-481a-ae6b-85fa0afbf9b7 1073741824" returned: 0 in 0.954s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b639d72a-15b4-481a-ae6b-85fa0afbf9b7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:52 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b639d72a-15b4-481a-ae6b-85fa0afbf9b7 Jul 22 12:20:52 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:53 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b639d72a-15b4-481a-ae6b-85fa0afbf9b7" returned: 0 in 0.485s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:20:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.219s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1773502470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=416202f9-65d0-4888-9cf2-4f5827153c0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2f9aaf299614cf3bb794e3cd74bfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:51Z,use_quota=True,user_id='77fda94bbbe4446eb8f2c152489e86d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:20:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Creating volume 416202f9-65d0-4888-9cf2-4f5827153c0a {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:20:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:20:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:20:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:20:53 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:20:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-416202f9-65d0-4888-9cf2-4f5827153c0a 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4bcced-40ef-4246-a992-c921dfcbed20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b639d72a-15b4-481a-ae6b-85fa0afbf9b7', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:53 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-416202f9-65d0-4888-9cf2-4f5827153c0a 1073741824 Jul 22 12:20:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b3b638-c303-43b6-bf7d-741b10339dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:53 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:53 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Volume volume-b639d72a-15b4-481a-ae6b-85fa0afbf9b7 (b639d72a-15b4-481a-ae6b-85fa0afbf9b7): created successfully Jul 22 12:20:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b3b638-c303-43b6-bf7d-741b10339dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Flow 'volume_create_manager' (4063e96f-511e-4d11-a976-5fbba4eadb7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:53 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e68c93a2-69f5-49e4-b1e7-2247532c475f tempest-CreateVolumesFromSnapshotTest-1448639784 None] Created volume successfully. Jul 22 12:20:53 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-416202f9-65d0-4888-9cf2-4f5827153c0a 1073741824" returned: 0 in 0.888s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:54 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:UPDATE=91,cinder:SELECT=76,cinder:INSERT=28,cinder:DELETE=6 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:20:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-416202f9-65d0-4888-9cf2-4f5827153c0a {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:54 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-416202f9-65d0-4888-9cf2-4f5827153c0a Jul 22 12:20:54 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:54 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-416202f9-65d0-4888-9cf2-4f5827153c0a" returned: 0 in 0.334s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:54 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:20:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.147s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:54 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-52380862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed498c4e-9966-4b61-b00a-67af4cf3c6a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2f9aaf299614cf3bb794e3cd74bfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:20:52Z,use_quota=True,user_id='77fda94bbbe4446eb8f2c152489e86d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:20:54 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Creating volume ed498c4e-9966-4b61-b00a-67af4cf3c6a2 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:20:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:54 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:20:54 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:20:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:54 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:20:54 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:20:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ed498c4e-9966-4b61-b00a-67af4cf3c6a2 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:54 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfbf9834-13e3-40de-b959-24550463093d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-416202f9-65d0-4888-9cf2-4f5827153c0a', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:54 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a9fd24-84e3-4b19-b4ec-dbdf5a0008d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:54 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ed498c4e-9966-4b61-b00a-67af4cf3c6a2 1073741824 Jul 22 12:20:54 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:54 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Volume volume-416202f9-65d0-4888-9cf2-4f5827153c0a (416202f9-65d0-4888-9cf2-4f5827153c0a): created successfully Jul 22 12:20:54 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a9fd24-84e3-4b19-b4ec-dbdf5a0008d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:54 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Flow 'volume_create_manager' (b4dcf67f-8e0e-4b70-ab14-d6a340633616) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:54 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e98a15c0-5845-4503-966d-0a8a268fd8ad tempest-CreateVolumesFromSnapshotTest-1448639784 None] Created volume successfully. Jul 22 12:20:55 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ed498c4e-9966-4b61-b00a-67af4cf3c6a2 1073741824" returned: 0 in 0.624s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ed498c4e-9966-4b61-b00a-67af4cf3c6a2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:55 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ed498c4e-9966-4b61-b00a-67af4cf3c6a2 Jul 22 12:20:55 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:55 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ed498c4e-9966-4b61-b00a-67af4cf3c6a2" returned: 0 in 0.314s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:55 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:20:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4397362f-234c-4373-97ec-ecf375be6243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed498c4e-9966-4b61-b00a-67af4cf3c6a2', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b1789da-80ff-41a6-bf93-1c6a89e14aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:20:55 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Volume volume-ed498c4e-9966-4b61-b00a-67af4cf3c6a2 (ed498c4e-9966-4b61-b00a-67af4cf3c6a2): created successfully Jul 22 12:20:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b1789da-80ff-41a6-bf93-1c6a89e14aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:20:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Flow 'volume_create_manager' (d7989e3d-d554-4acc-9c1a-99ea4ca856a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:20:55 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-6c8efc77-d64f-45df-81a4-82a821156335 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Created volume successfully. Jul 22 12:20:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5b3010c0-93b4-4e6c-96cf-57c7ec7c2358 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "cinder-ed498c4e-9966-4b61-b00a-67af4cf3c6a2-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:20:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5b3010c0-93b4-4e6c-96cf-57c7ec7c2358 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-ed498c4e-9966-4b61-b00a-67af4cf3c6a2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:20:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5b3010c0-93b4-4e6c-96cf-57c7ec7c2358 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "cinder-quobyte-ed498c4e-9966-4b61-b00a-67af4cf3c6a2" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:20:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5b3010c0-93b4-4e6c-96cf-57c7ec7c2358 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-quobyte-ed498c4e-9966-4b61-b00a-67af4cf3c6a2" acquired by "delete_volume" :: waited 0.031s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:20:56 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cb45d2-390f-45d2-83dd-3652bcefffc0]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:20:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5b3010c0-93b4-4e6c-96cf-57c7ec7c2358 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ed498c4e-9966-4b61-b00a-67af4cf3c6a2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:56 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ed498c4e-9966-4b61-b00a-67af4cf3c6a2 Jul 22 12:20:56 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:56 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5b3010c0-93b4-4e6c-96cf-57c7ec7c2358 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ed498c4e-9966-4b61-b00a-67af4cf3c6a2" returned: 0 in 0.591s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5b3010c0-93b4-4e6c-96cf-57c7ec7c2358 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ed498c4e-9966-4b61-b00a-67af4cf3c6a2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:56 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ed498c4e-9966-4b61-b00a-67af4cf3c6a2 Jul 22 12:20:56 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:57 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5b3010c0-93b4-4e6c-96cf-57c7ec7c2358 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ed498c4e-9966-4b61-b00a-67af4cf3c6a2" returned: 0 in 0.370s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5b3010c0-93b4-4e6c-96cf-57c7ec7c2358 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-quobyte-ed498c4e-9966-4b61-b00a-67af4cf3c6a2" released by "delete_volume" :: held 1.043s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:20:57 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-5b3010c0-93b4-4e6c-96cf-57c7ec7c2358 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Created reservations ['96a9c00d-ccf9-4902-9d4a-7091c6ccb7b5', 'f80afd52-87e5-4879-895e-3cff4ee75baa', '0633b48e-ea6e-40ab-bf72-041eb8061818', 'e6789c8f-f529-41bf-858f-86218e52ee07'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:20:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5b3010c0-93b4-4e6c-96cf-57c7ec7c2358 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5b3010c0-93b4-4e6c-96cf-57c7ec7c2358 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5b3010c0-93b4-4e6c-96cf-57c7ec7c2358 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:20:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5b3010c0-93b4-4e6c-96cf-57c7ec7c2358 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:20:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5b3010c0-93b4-4e6c-96cf-57c7ec7c2358 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5b3010c0-93b4-4e6c-96cf-57c7ec7c2358 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:57 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:20:57 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:57 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5b3010c0-93b4-4e6c-96cf-57c7ec7c2358 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.293s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:57 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-5b3010c0-93b4-4e6c-96cf-57c7ec7c2358 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:20:57 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-5b3010c0-93b4-4e6c-96cf-57c7ec7c2358 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Deleted volume successfully. Jul 22 12:20:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5b3010c0-93b4-4e6c-96cf-57c7ec7c2358 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-ed498c4e-9966-4b61-b00a-67af4cf3c6a2-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:20:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a7341f86-e8af-48f1-b542-1a4f30f84bcd tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "cinder-416202f9-65d0-4888-9cf2-4f5827153c0a-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:20:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a7341f86-e8af-48f1-b542-1a4f30f84bcd tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-416202f9-65d0-4888-9cf2-4f5827153c0a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:20:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a7341f86-e8af-48f1-b542-1a4f30f84bcd tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "cinder-quobyte-416202f9-65d0-4888-9cf2-4f5827153c0a" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:20:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a7341f86-e8af-48f1-b542-1a4f30f84bcd tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-quobyte-416202f9-65d0-4888-9cf2-4f5827153c0a" acquired by "delete_volume" :: waited 0.031s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:20:58 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eaab53a-03ce-4ed4-ba41-ed5d22ce0c94]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:20:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a7341f86-e8af-48f1-b542-1a4f30f84bcd tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-416202f9-65d0-4888-9cf2-4f5827153c0a {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:58 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-416202f9-65d0-4888-9cf2-4f5827153c0a Jul 22 12:20:58 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:58 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a7341f86-e8af-48f1-b542-1a4f30f84bcd tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-416202f9-65d0-4888-9cf2-4f5827153c0a" returned: 0 in 0.424s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a7341f86-e8af-48f1-b542-1a4f30f84bcd tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-416202f9-65d0-4888-9cf2-4f5827153c0a {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:59 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-416202f9-65d0-4888-9cf2-4f5827153c0a Jul 22 12:20:59 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:20:59 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Jul 22 12:20:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a7341f86-e8af-48f1-b542-1a4f30f84bcd tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-416202f9-65d0-4888-9cf2-4f5827153c0a" returned: 0 in 0.342s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:20:59 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a7341f86-e8af-48f1-b542-1a4f30f84bcd tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-quobyte-416202f9-65d0-4888-9cf2-4f5827153c0a" released by "delete_volume" :: held 0.902s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:20:59 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-a7341f86-e8af-48f1-b542-1a4f30f84bcd tempest-CreateVolumesFromSnapshotTest-1448639784 None] Created reservations ['515ea7e5-ed6a-46a9-b219-6aa462419a75', '2be8829b-7e5f-496c-a2a0-71d79a5d3f95', '34610977-de44-43a9-b65d-4b4cfd595dd9', 'bf00a246-efd0-4bf6-b2af-3271a8958141'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:20:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a7341f86-e8af-48f1-b542-1a4f30f84bcd tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:20:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a7341f86-e8af-48f1-b542-1a4f30f84bcd tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:20:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a7341f86-e8af-48f1-b542-1a4f30f84bcd tempest-CreateVolumesFromSnapshotTest-1448639784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:20:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a7341f86-e8af-48f1-b542-1a4f30f84bcd tempest-CreateVolumesFromSnapshotTest-1448639784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:20:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a7341f86-e8af-48f1-b542-1a4f30f84bcd tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:20:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a7341f86-e8af-48f1-b542-1a4f30f84bcd tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:20:59 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:20:59 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:00 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a7341f86-e8af-48f1-b542-1a4f30f84bcd tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.523s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:00 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-a7341f86-e8af-48f1-b542-1a4f30f84bcd tempest-CreateVolumesFromSnapshotTest-1448639784 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:21:00 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-a7341f86-e8af-48f1-b542-1a4f30f84bcd tempest-CreateVolumesFromSnapshotTest-1448639784 None] Deleted volume successfully. Jul 22 12:21:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a7341f86-e8af-48f1-b542-1a4f30f84bcd tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-416202f9-65d0-4888-9cf2-4f5827153c0a-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3b430ec3-5a3c-4264-afc9-8c3e9b0c09d8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "cinder-b639d72a-15b4-481a-ae6b-85fa0afbf9b7-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3b430ec3-5a3c-4264-afc9-8c3e9b0c09d8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-b639d72a-15b4-481a-ae6b-85fa0afbf9b7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3b430ec3-5a3c-4264-afc9-8c3e9b0c09d8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "cinder-quobyte-b639d72a-15b4-481a-ae6b-85fa0afbf9b7" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3b430ec3-5a3c-4264-afc9-8c3e9b0c09d8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-quobyte-b639d72a-15b4-481a-ae6b-85fa0afbf9b7" acquired by "delete_volume" :: waited 0.027s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:00 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae7f692-2a0d-44c8-bc57-2b997ac965c8]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:21:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3b430ec3-5a3c-4264-afc9-8c3e9b0c09d8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b639d72a-15b4-481a-ae6b-85fa0afbf9b7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:00 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b639d72a-15b4-481a-ae6b-85fa0afbf9b7 Jul 22 12:21:00 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:01 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3b430ec3-5a3c-4264-afc9-8c3e9b0c09d8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b639d72a-15b4-481a-ae6b-85fa0afbf9b7" returned: 0 in 0.500s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3b430ec3-5a3c-4264-afc9-8c3e9b0c09d8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b639d72a-15b4-481a-ae6b-85fa0afbf9b7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:01 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b639d72a-15b4-481a-ae6b-85fa0afbf9b7 Jul 22 12:21:01 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:01 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3b430ec3-5a3c-4264-afc9-8c3e9b0c09d8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b639d72a-15b4-481a-ae6b-85fa0afbf9b7" returned: 0 in 0.300s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3b430ec3-5a3c-4264-afc9-8c3e9b0c09d8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-quobyte-b639d72a-15b4-481a-ae6b-85fa0afbf9b7" released by "delete_volume" :: held 0.863s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:01 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-3b430ec3-5a3c-4264-afc9-8c3e9b0c09d8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Created reservations ['014a142b-20f0-4df4-a14e-40f73901064f', '1263ca41-cc43-4227-869c-c4e70711609a', '3da31674-b757-42d8-86b5-c8b69ea4f376', '8d6e7d88-e0d2-4c71-a1df-7dac28401ab5'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:21:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3b430ec3-5a3c-4264-afc9-8c3e9b0c09d8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3b430ec3-5a3c-4264-afc9-8c3e9b0c09d8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3b430ec3-5a3c-4264-afc9-8c3e9b0c09d8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:21:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3b430ec3-5a3c-4264-afc9-8c3e9b0c09d8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:21:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3b430ec3-5a3c-4264-afc9-8c3e9b0c09d8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3b430ec3-5a3c-4264-afc9-8c3e9b0c09d8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:01 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:21:01 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-04b1de9d-b430-491c-991d-785b9ee6ee03 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "cinder-3dcb1c17-afa9-4a7e-9642-951c0fa98022-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:02 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-04b1de9d-b430-491c-991d-785b9ee6ee03 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-3dcb1c17-afa9-4a7e-9642-951c0fa98022-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:02 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-04b1de9d-b430-491c-991d-785b9ee6ee03 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "cinder-quobyte-3dcb1c17-afa9-4a7e-9642-951c0fa98022" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:02 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-04b1de9d-b430-491c-991d-785b9ee6ee03 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-quobyte-3dcb1c17-afa9-4a7e-9642-951c0fa98022" acquired by "delete_volume" :: waited 0.037s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:02 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3b430ec3-5a3c-4264-afc9-8c3e9b0c09d8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.568s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:02 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-3b430ec3-5a3c-4264-afc9-8c3e9b0c09d8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:21:02 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-3b430ec3-5a3c-4264-afc9-8c3e9b0c09d8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Deleted volume successfully. Jul 22 12:21:02 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d533f3-066e-4dce-99c0-00dfee6eed51]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:21:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-04b1de9d-b430-491c-991d-785b9ee6ee03 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3dcb1c17-afa9-4a7e-9642-951c0fa98022 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:02 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3b430ec3-5a3c-4264-afc9-8c3e9b0c09d8 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-b639d72a-15b4-481a-ae6b-85fa0afbf9b7-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:02 devstack sudo[100716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3dcb1c17-afa9-4a7e-9642-951c0fa98022 Jul 22 12:21:02 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:03 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-04b1de9d-b430-491c-991d-785b9ee6ee03 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3dcb1c17-afa9-4a7e-9642-951c0fa98022" returned: 0 in 0.630s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-04b1de9d-b430-491c-991d-785b9ee6ee03 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3dcb1c17-afa9-4a7e-9642-951c0fa98022 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:03 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3dcb1c17-afa9-4a7e-9642-951c0fa98022 Jul 22 12:21:03 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:03 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-04b1de9d-b430-491c-991d-785b9ee6ee03 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3dcb1c17-afa9-4a7e-9642-951c0fa98022" returned: 0 in 0.571s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:03 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-04b1de9d-b430-491c-991d-785b9ee6ee03 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-quobyte-3dcb1c17-afa9-4a7e-9642-951c0fa98022" released by "delete_volume" :: held 1.359s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:03 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-04b1de9d-b430-491c-991d-785b9ee6ee03 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Created reservations ['9df69af3-4c7a-4dc6-925e-8bd82648cbc5', 'c10da027-5c0a-4d16-8981-103cf7bb9a9b', 'a9f5df1e-a24d-47db-a4ab-e97642570fb1', 'c179afbf-44a9-4bcd-ae98-64a206edfccc'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:21:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-04b1de9d-b430-491c-991d-785b9ee6ee03 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-04b1de9d-b430-491c-991d-785b9ee6ee03 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:03 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-04b1de9d-b430-491c-991d-785b9ee6ee03 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:21:03 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-04b1de9d-b430-491c-991d-785b9ee6ee03 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:21:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-04b1de9d-b430-491c-991d-785b9ee6ee03 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-04b1de9d-b430-491c-991d-785b9ee6ee03 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:03 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:21:03 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:04 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-04b1de9d-b430-491c-991d-785b9ee6ee03 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.317s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:04 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-04b1de9d-b430-491c-991d-785b9ee6ee03 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:21:04 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-04b1de9d-b430-491c-991d-785b9ee6ee03 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Deleted volume successfully. Jul 22 12:21:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-04b1de9d-b430-491c-991d-785b9ee6ee03 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-3dcb1c17-afa9-4a7e-9642-951c0fa98022-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4a6ac226-132d-404a-b45a-54f0b6ef0886 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "cinder-f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4a6ac226-132d-404a-b45a-54f0b6ef0886 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4a6ac226-132d-404a-b45a-54f0b6ef0886 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "cinder-quobyte-f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4a6ac226-132d-404a-b45a-54f0b6ef0886 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-quobyte-f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a" acquired by "delete_volume" :: waited 0.022s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:04 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e924cb49-0635-4fc1-a9f9-0bda45ee5352]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:21:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4a6ac226-132d-404a-b45a-54f0b6ef0886 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:04 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a Jul 22 12:21:04 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:05 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4a6ac226-132d-404a-b45a-54f0b6ef0886 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a" returned: 0 in 0.780s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4a6ac226-132d-404a-b45a-54f0b6ef0886 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:05 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a Jul 22 12:21:05 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:06 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4a6ac226-132d-404a-b45a-54f0b6ef0886 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a" returned: 0 in 0.746s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4a6ac226-132d-404a-b45a-54f0b6ef0886 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-quobyte-f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a" released by "delete_volume" :: held 1.627s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Flow 'volume_create_manager' (e41b0a9c-c42a-489f-9c7f-90967130e2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7735dc8e-5f15-4aee-aaaf-e66222144a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7735dc8e-5f15-4aee-aaaf-e66222144a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1108807543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ad7495-e6e8-4939-98b7-4bce4bbac50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ade654df4797445c946fcbf94629bc8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:21:06Z,use_quota=True,user_id='7fc589a40c6242dc890d79fec076bf66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80d92a1-3097-4fe1-9fbe-67a759c76d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80d92a1-3097-4fe1-9fbe-67a759c76d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72117a2-d273-4f5f-aa0c-83cc9d596244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72117a2-d273-4f5f-aa0c-83cc9d596244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93ad7495-e6e8-4939-98b7-4bce4bbac50c', 'volume_name': 'volume-93ad7495-e6e8-4939-98b7-4bce4bbac50c', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d09ed80-3bfd-464d-b6c4-d43b93503789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d09ed80-3bfd-464d-b6c4-d43b93503789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b477dc63-bdb8-40bd-b801-b5aa232cf277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:06 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Volume 93ad7495-e6e8-4939-98b7-4bce4bbac50c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93ad7495-e6e8-4939-98b7-4bce4bbac50c', 'volume_size': 1} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1108807543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ad7495-e6e8-4939-98b7-4bce4bbac50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ade654df4797445c946fcbf94629bc8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:21:06Z,use_quota=True,user_id='7fc589a40c6242dc890d79fec076bf66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Creating volume 93ad7495-e6e8-4939-98b7-4bce4bbac50c {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:21:06 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-93ad7495-e6e8-4939-98b7-4bce4bbac50c 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-4a6ac226-132d-404a-b45a-54f0b6ef0886 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Created reservations ['fc89c5a4-fdf9-497f-829a-3aee7a04b631', '06e5a2ae-ecbe-42b3-850b-60341a5f0ab7', 'da985a26-175c-4c07-b3ca-5bff299e4527', '46f72a7e-27d7-4701-b8ef-89d39e4fd1da'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:21:06 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-93ad7495-e6e8-4939-98b7-4bce4bbac50c 1073741824 Jul 22 12:21:06 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4a6ac226-132d-404a-b45a-54f0b6ef0886 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4a6ac226-132d-404a-b45a-54f0b6ef0886 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4a6ac226-132d-404a-b45a-54f0b6ef0886 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4a6ac226-132d-404a-b45a-54f0b6ef0886 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4a6ac226-132d-404a-b45a-54f0b6ef0886 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4a6ac226-132d-404a-b45a-54f0b6ef0886 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:06 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:21:06 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-25475931-2d2b-488b-a42e-8d02d3af6836 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "cinder-0e17ad65-39ce-4d77-a06b-9c6557bcf532-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:07 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4a6ac226-132d-404a-b45a-54f0b6ef0886 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.535s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:07 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-4a6ac226-132d-404a-b45a-54f0b6ef0886 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:21:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-25475931-2d2b-488b-a42e-8d02d3af6836 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-0e17ad65-39ce-4d77-a06b-9c6557bcf532-delete_snapshot" acquired by "delete_snapshot" :: waited 0.108s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-25475931-2d2b-488b-a42e-8d02d3af6836 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "cinder-quobyte-aa69748f-58d0-4623-bf4b-4523c6964c32" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:07 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-4a6ac226-132d-404a-b45a-54f0b6ef0886 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Deleted volume successfully. Jul 22 12:21:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-25475931-2d2b-488b-a42e-8d02d3af6836 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-quobyte-aa69748f-58d0-4623-bf4b-4523c6964c32" acquired by "delete_snapshot" :: waited 0.071s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-25475931-2d2b-488b-a42e-8d02d3af6836 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "cinder-quobyte-0e17ad65-39ce-4d77-a06b-9c6557bcf532" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4a6ac226-132d-404a-b45a-54f0b6ef0886 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-f58b3d32-9a49-4d6b-8c97-c3ec2985cb4a-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-25475931-2d2b-488b-a42e-8d02d3af6836 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-quobyte-0e17ad65-39ce-4d77-a06b-9c6557bcf532" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-25475931-2d2b-488b-a42e-8d02d3af6836 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Deleting offline snapshot 0e17ad65-39ce-4d77-a06b-9c6557bcf532 of volume aa69748f-58d0-4623-bf4b-4523c6964c32 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:21:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-25475931-2d2b-488b-a42e-8d02d3af6836 tempest-CreateVolumesFromSnapshotTest-1448639784 None] snapshot_file for this snap is: volume-aa69748f-58d0-4623-bf4b-4523c6964c32.0e17ad65-39ce-4d77-a06b-9c6557bcf532 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:21:07 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b1f354-47d4-4849-985f-29621f4f52eb]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:21:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-25475931-2d2b-488b-a42e-8d02d3af6836 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.0e17ad65-39ce-4d77-a06b-9c6557bcf532 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:07 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-93ad7495-e6e8-4939-98b7-4bce4bbac50c 1073741824" returned: 0 in 1.101s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-93ad7495-e6e8-4939-98b7-4bce4bbac50c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:07 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.0e17ad65-39ce-4d77-a06b-9c6557bcf532 Jul 22 12:21:07 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:07 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-93ad7495-e6e8-4939-98b7-4bce4bbac50c Jul 22 12:21:07 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:08 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-93ad7495-e6e8-4939-98b7-4bce4bbac50c" returned: 0 in 0.414s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:21:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b477dc63-bdb8-40bd-b801-b5aa232cf277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ad7495-e6e8-4939-98b7-4bce4bbac50c', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb4cc7b-b60a-470a-9fb3-e3d832adc6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:08 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Volume volume-93ad7495-e6e8-4939-98b7-4bce4bbac50c (93ad7495-e6e8-4939-98b7-4bce4bbac50c): created successfully Jul 22 12:21:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb4cc7b-b60a-470a-9fb3-e3d832adc6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Flow 'volume_create_manager' (e41b0a9c-c42a-489f-9c7f-90967130e2d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:21:08 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-1ac9deff-d047-4040-b448-34ee498a3549 tempest-TestMinimumBasicScenario-436212127 None] Created volume successfully. Jul 22 12:21:08 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-25475931-2d2b-488b-a42e-8d02d3af6836 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.0e17ad65-39ce-4d77-a06b-9c6557bcf532" returned: 0 in 0.766s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-25475931-2d2b-488b-a42e-8d02d3af6836 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa69748f-58d0-4623-bf4b-4523c6964c32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:21:08 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c35df7-04cb-42c9-a8f1-06f7745d1f91]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:21:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-25475931-2d2b-488b-a42e-8d02d3af6836 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:08 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32 Jul 22 12:21:08 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:08 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-25475931-2d2b-488b-a42e-8d02d3af6836 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32" returned: 0 in 0.562s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-25475931-2d2b-488b-a42e-8d02d3af6836 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.0e17ad65-39ce-4d77-a06b-9c6557bcf532 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:08 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.0e17ad65-39ce-4d77-a06b-9c6557bcf532 Jul 22 12:21:08 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:09 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-25475931-2d2b-488b-a42e-8d02d3af6836 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.0e17ad65-39ce-4d77-a06b-9c6557bcf532" returned: 0 in 0.473s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-25475931-2d2b-488b-a42e-8d02d3af6836 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.0e17ad65-39ce-4d77-a06b-9c6557bcf532 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:09 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.0e17ad65-39ce-4d77-a06b-9c6557bcf532 Jul 22 12:21:09 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:09 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-25475931-2d2b-488b-a42e-8d02d3af6836 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32.0e17ad65-39ce-4d77-a06b-9c6557bcf532" returned: 0 in 0.504s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:10 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-25475931-2d2b-488b-a42e-8d02d3af6836 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-quobyte-0e17ad65-39ce-4d77-a06b-9c6557bcf532" released by "_delete_snapshot" :: held 2.548s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:10 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-25475931-2d2b-488b-a42e-8d02d3af6836 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-quobyte-aa69748f-58d0-4623-bf4b-4523c6964c32" released by "delete_snapshot" :: held 2.605s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:10 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-25475931-2d2b-488b-a42e-8d02d3af6836 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Created reservations ['1d819416-d8c5-4f9c-a5f8-f147a78e61d0', 'd0f1f0ec-7275-45b7-989d-eacc781cd742', '5dbd4d71-b3c6-45e4-b19a-7bf160ca6b2f', 'd9e0eeea-526e-4920-93ed-3b8c2c8aeaad'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:21:10 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-25475931-2d2b-488b-a42e-8d02d3af6836 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Delete snapshot completed successfully. Jul 22 12:21:10 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-25475931-2d2b-488b-a42e-8d02d3af6836 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-0e17ad65-39ce-4d77-a06b-9c6557bcf532-delete_snapshot" released by "delete_snapshot" :: held 3.007s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:10 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ecfe9d0a-9236-48f0-afde-302b37315178 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "cinder-aa69748f-58d0-4623-bf4b-4523c6964c32-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:10 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ecfe9d0a-9236-48f0-afde-302b37315178 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-aa69748f-58d0-4623-bf4b-4523c6964c32-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:10 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ecfe9d0a-9236-48f0-afde-302b37315178 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "cinder-quobyte-aa69748f-58d0-4623-bf4b-4523c6964c32" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:10 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ecfe9d0a-9236-48f0-afde-302b37315178 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-quobyte-aa69748f-58d0-4623-bf4b-4523c6964c32" acquired by "delete_volume" :: waited 0.026s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:10 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49f6c1c-7d6b-424f-a8c0-e563ba6e8259]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:21:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ecfe9d0a-9236-48f0-afde-302b37315178 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-61efb04d-dae5-4292-9aa0-c2551adedb35 req-dc045bd6-f6d4-45bb-ab6a-b349f99ea5e1 tempest-TestMinimumBasicScenario-436212127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-61efb04d-dae5-4292-9aa0-c2551adedb35 req-dc045bd6-f6d4-45bb-ab6a-b349f99ea5e1 tempest-TestMinimumBasicScenario-436212127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-61efb04d-dae5-4292-9aa0-c2551adedb35 req-dc045bd6-f6d4-45bb-ab6a-b349f99ea5e1 tempest-TestMinimumBasicScenario-436212127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-61efb04d-dae5-4292-9aa0-c2551adedb35 req-dc045bd6-f6d4-45bb-ab6a-b349f99ea5e1 tempest-TestMinimumBasicScenario-436212127 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29', 'name': 'volume-93ad7495-e6e8-4939-98b7-4bce4bbac50c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b74f20d5-c75c-49bd-8c1f-d6c1cd080f3a', 'enforce_multipath': True} {{(pid=87568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 12:21:11 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32 Jul 22 12:21:11 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:11 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-61efb04d-dae5-4292-9aa0-c2551adedb35 req-dc045bd6-f6d4-45bb-ab6a-b349f99ea5e1 tempest-TestMinimumBasicScenario-436212127 None] attachment_update completed successfully. Jul 22 12:21:11 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=106,cinder:UPDATE=120,cinder:DELETE=16,cinder:INSERT=30 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:21:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-1fcd9bac-cbfb-48f5-996c-fdc11647d716 req-9ef6ad31-c378-4986-8568-dcc0b5c7eed7 tempest-TestInstancesWithCinderVolumes-1017353710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-1fcd9bac-cbfb-48f5-996c-fdc11647d716 req-9ef6ad31-c378-4986-8568-dcc0b5c7eed7 tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-1fcd9bac-cbfb-48f5-996c-fdc11647d716 req-9ef6ad31-c378-4986-8568-dcc0b5c7eed7 tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:11 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ecfe9d0a-9236-48f0-afde-302b37315178 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32" returned: 0 in 0.780s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ecfe9d0a-9236-48f0-afde-302b37315178 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-1fcd9bac-cbfb-48f5-996c-fdc11647d716 req-9ef6ad31-c378-4986-8568-dcc0b5c7eed7 tempest-TestInstancesWithCinderVolumes-1017353710 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29', 'name': 'volume-d20fc1b5-c2c8-402c-846c-b75ec5f570bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd502e21c-70d1-43c0-a64a-d344c684b9b7', 'enforce_multipath': True} {{(pid=87568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 12:21:11 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32 Jul 22 12:21:11 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:11 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-1fcd9bac-cbfb-48f5-996c-fdc11647d716 req-9ef6ad31-c378-4986-8568-dcc0b5c7eed7 tempest-TestInstancesWithCinderVolumes-1017353710 None] attachment_update completed successfully. Jul 22 12:21:12 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ecfe9d0a-9236-48f0-afde-302b37315178 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa69748f-58d0-4623-bf4b-4523c6964c32" returned: 0 in 0.610s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ecfe9d0a-9236-48f0-afde-302b37315178 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-quobyte-aa69748f-58d0-4623-bf4b-4523c6964c32" released by "delete_volume" :: held 1.532s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:12 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-ecfe9d0a-9236-48f0-afde-302b37315178 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Created reservations ['3704fa94-33e7-4ab4-b642-0bd1a85a0b13', '2370b413-aee2-4f8d-9705-95525e345e7d', '531ca4c3-438b-4059-9793-bb75a1053b7d', '86817a95-9778-4efb-877c-ee447371c95c'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:21:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ecfe9d0a-9236-48f0-afde-302b37315178 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ecfe9d0a-9236-48f0-afde-302b37315178 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ecfe9d0a-9236-48f0-afde-302b37315178 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:21:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ecfe9d0a-9236-48f0-afde-302b37315178 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:21:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ecfe9d0a-9236-48f0-afde-302b37315178 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ecfe9d0a-9236-48f0-afde-302b37315178 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:12 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:21:12 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:13 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ecfe9d0a-9236-48f0-afde-302b37315178 tempest-CreateVolumesFromSnapshotTest-1448639784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.614s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:13 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-ecfe9d0a-9236-48f0-afde-302b37315178 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:21:13 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-ecfe9d0a-9236-48f0-afde-302b37315178 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Deleted volume successfully. Jul 22 12:21:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ecfe9d0a-9236-48f0-afde-302b37315178 tempest-CreateVolumesFromSnapshotTest-1448639784 None] Lock "cinder-aa69748f-58d0-4623-bf4b-4523c6964c32-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-eccea7d4-75de-4ccf-b41a-bb288a0fac7d req-ec607598-54cf-4321-909d-2be0d01f9301 tempest-TestInstancesWithCinderVolumes-1017353710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-eccea7d4-75de-4ccf-b41a-bb288a0fac7d req-ec607598-54cf-4321-909d-2be0d01f9301 tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-eccea7d4-75de-4ccf-b41a-bb288a0fac7d req-ec607598-54cf-4321-909d-2be0d01f9301 tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:15 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-eccea7d4-75de-4ccf-b41a-bb288a0fac7d req-ec607598-54cf-4321-909d-2be0d01f9301 tempest-TestInstancesWithCinderVolumes-1017353710 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29', 'name': 'volume-d62eb484-642b-4dd4-8086-94bba1a93b9e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f568911c-45c9-4007-8d11-a48217df477f', 'enforce_multipath': True} {{(pid=87568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 12:21:15 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-eccea7d4-75de-4ccf-b41a-bb288a0fac7d req-ec607598-54cf-4321-909d-2be0d01f9301 tempest-TestInstancesWithCinderVolumes-1017353710 None] attachment_update completed successfully. Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Flow 'volume_create_manager' (b010f9a3-fcfa-490a-894d-6b291b35f26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53542c68-5d6e-4d10-a0e5-59fcb19ca3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53542c68-5d6e-4d10-a0e5-59fcb19ca3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1697893511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a62544e-f9d1-47b7-894d-b05d5f4fa86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4b5eabefa994f4d9829e9845eb3d0b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:21:16Z,use_quota=True,user_id='980f55cc14e24a61a819e9244bc16bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f695b7b8-8aae-43f7-9112-879c8d6f4ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f695b7b8-8aae-43f7-9112-879c8d6f4ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d021ba-3f9f-4ab1-8f6a-7661000eab3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d021ba-3f9f-4ab1-8f6a-7661000eab3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a62544e-f9d1-47b7-894d-b05d5f4fa86c', 'volume_name': 'volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53185fe7-6788-4b83-95a1-85d9ff748ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53185fe7-6788-4b83-95a1-85d9ff748ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d0fd02-2dd6-44d5-9c8e-42240f95cd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:16 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Volume 6a62544e-f9d1-47b7-894d-b05d5f4fa86c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c', 'volume_size': 1} Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1697893511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a62544e-f9d1-47b7-894d-b05d5f4fa86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4b5eabefa994f4d9829e9845eb3d0b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:21:16Z,use_quota=True,user_id='980f55cc14e24a61a819e9244bc16bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Creating volume 6a62544e-f9d1-47b7-894d-b05d5f4fa86c {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:21:16 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:16 devstack sudo[100864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c 1073741824 Jul 22 12:21:16 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:16 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c 1073741824" returned: 0 in 0.624s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:16 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c Jul 22 12:21:16 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:17 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c" returned: 0 in 0.440s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:21:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d0fd02-2dd6-44d5-9c8e-42240f95cd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c39250c-8351-450b-81ee-8897ca557d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:17 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Volume volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c (6a62544e-f9d1-47b7-894d-b05d5f4fa86c): created successfully Jul 22 12:21:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c39250c-8351-450b-81ee-8897ca557d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Flow 'volume_create_manager' (b010f9a3-fcfa-490a-894d-6b291b35f26f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:21:17 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-9be15aab-eae9-4ced-ae3d-5608c6c68c29 tempest-TestStampPattern-738882885 None] Created volume successfully. Jul 22 12:21:18 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:21:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Flow 'volume_create_manager' (c4b34d1e-bd83-451a-9b02-9853bde58bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:21:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950bfa11-9462-465e-aaa4-4ad8bf95ac68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950bfa11-9462-465e-aaa4-4ad8bf95ac68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e8e47d-73a7-47f1-bf21-e92b4d13fd44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe6471578134a7ab0d542d61f02892b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:21:18Z,use_quota=True,user_id='bb85220622ae485bbe8625c0e4a2a700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57867607-1c33-4515-a278-87c99664061a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57867607-1c33-4515-a278-87c99664061a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a9376f-6375-445f-ab25-b2410bd68a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a9376f-6375-445f-ab25-b2410bd68a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19e8e47d-73a7-47f1-bf21-e92b4d13fd44', 'volume_name': 'volume-19e8e47d-73a7-47f1-bf21-e92b4d13fd44', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16118dcc-ed50-4dc2-a652-a55fdc8ec91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16118dcc-ed50-4dc2-a652-a55fdc8ec91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (582d8129-6fc2-487f-a630-df720a4f95a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:18 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Volume 19e8e47d-73a7-47f1-bf21-e92b4d13fd44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19e8e47d-73a7-47f1-bf21-e92b4d13fd44', 'volume_size': 1} Jul 22 12:21:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e8e47d-73a7-47f1-bf21-e92b4d13fd44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe6471578134a7ab0d542d61f02892b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:21:18Z,use_quota=True,user_id='bb85220622ae485bbe8625c0e4a2a700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:21:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Creating volume 19e8e47d-73a7-47f1-bf21-e92b4d13fd44 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:21:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:21:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:21:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:21:18 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:21:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19e8e47d-73a7-47f1-bf21-e92b4d13fd44 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:18 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19e8e47d-73a7-47f1-bf21-e92b4d13fd44 1073741824 Jul 22 12:21:18 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:19 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19e8e47d-73a7-47f1-bf21-e92b4d13fd44 1073741824" returned: 0 in 0.701s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19e8e47d-73a7-47f1-bf21-e92b4d13fd44 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:19 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19e8e47d-73a7-47f1-bf21-e92b4d13fd44 Jul 22 12:21:19 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:19 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19e8e47d-73a7-47f1-bf21-e92b4d13fd44" returned: 0 in 0.459s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:21:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (582d8129-6fc2-487f-a630-df720a4f95a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19e8e47d-73a7-47f1-bf21-e92b4d13fd44', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808a3d40-3acb-45a3-a62d-f4f58d8b032e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:19 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Volume volume-19e8e47d-73a7-47f1-bf21-e92b4d13fd44 (19e8e47d-73a7-47f1-bf21-e92b4d13fd44): created successfully Jul 22 12:21:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808a3d40-3acb-45a3-a62d-f4f58d8b032e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Flow 'volume_create_manager' (c4b34d1e-bd83-451a-9b02-9853bde58bdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:21:19 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-8e362575-2439-439f-8d81-d587f723199a tempest-CinderUnicodeTest-2091821831 None] Created volume successfully. Jul 22 12:21:21 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:21:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Flow 'volume_create_manager' (7ae9e8bb-8174-4427-b29e-5468d888b5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:21:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77c1ad29-d48a-4687-826e-c95c698bf596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77c1ad29-d48a-4687-826e-c95c698bf596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:21:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-728260454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08d07559-b2bd-4b64-87f3-a8672b39ecda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe6471578134a7ab0d542d61f02892b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:21:21Z,use_quota=True,user_id='bb85220622ae485bbe8625c0e4a2a700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c3a455c-f5d3-419d-acb7-2dea060a6230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c3a455c-f5d3-419d-acb7-2dea060a6230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3883c4-a64f-482b-842e-28c465de1962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3883c4-a64f-482b-842e-28c465de1962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08d07559-b2bd-4b64-87f3-a8672b39ecda', 'volume_name': 'volume-08d07559-b2bd-4b64-87f3-a8672b39ecda', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3dfe2b3-43c6-408e-a85f-791944146ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3dfe2b3-43c6-408e-a85f-791944146ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6e5206-2adf-4171-81cd-07b5ee8c4e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:21 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Volume 08d07559-b2bd-4b64-87f3-a8672b39ecda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08d07559-b2bd-4b64-87f3-a8672b39ecda', 'volume_size': 1} Jul 22 12:21:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:21:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-728260454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08d07559-b2bd-4b64-87f3-a8672b39ecda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe6471578134a7ab0d542d61f02892b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:21:21Z,use_quota=True,user_id='bb85220622ae485bbe8625c0e4a2a700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:21:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Creating volume 08d07559-b2bd-4b64-87f3-a8672b39ecda {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:21:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:21:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:21:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:21:21 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:21:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:21 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda 1073741824 Jul 22 12:21:21 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:22 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda 1073741824" returned: 0 in 0.750s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:22 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda Jul 22 12:21:22 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:22 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-0a576195-9780-49fd-9f0b-76eb988e5362 req-9b10cd58-b951-4f25-a624-4dd701d9f6f6 tempest-TestInstancesWithCinderVolumes-1017353710 None] Terminate volume connection completed successfully. Jul 22 12:21:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-0a576195-9780-49fd-9f0b-76eb988e5362 req-9b10cd58-b951-4f25-a624-4dd701d9f6f6 tempest-TestInstancesWithCinderVolumes-1017353710 None] Deleting attachment d502e21c-70d1-43c0-a64a-d344c684b9b7. {{(pid=87568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 12:21:22 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda" returned: 0 in 0.622s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:21:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6e5206-2adf-4171-81cd-07b5ee8c4e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08d07559-b2bd-4b64-87f3-a8672b39ecda', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53bdecbc-9f8b-4f90-a19e-34a6839ae359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:21:23 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Volume volume-08d07559-b2bd-4b64-87f3-a8672b39ecda (08d07559-b2bd-4b64-87f3-a8672b39ecda): created successfully Jul 22 12:21:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53bdecbc-9f8b-4f90-a19e-34a6839ae359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:21:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Flow 'volume_create_manager' (7ae9e8bb-8174-4427-b29e-5468d888b5a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:21:23 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-c5038117-1321-40a0-b388-983e6e28b100 tempest-CinderUnicodeTest-2091821831 None] Created volume successfully. Jul 22 12:21:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ed81d1fb-cd80-4d94-97de-e9c5de2885bb tempest-TestInstancesWithCinderVolumes-1017353710 None] Acquiring lock "cinder-d20fc1b5-c2c8-402c-846c-b75ec5f570bf-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ed81d1fb-cd80-4d94-97de-e9c5de2885bb tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "cinder-d20fc1b5-c2c8-402c-846c-b75ec5f570bf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ed81d1fb-cd80-4d94-97de-e9c5de2885bb tempest-TestInstancesWithCinderVolumes-1017353710 None] Acquiring lock "cinder-quobyte-d20fc1b5-c2c8-402c-846c-b75ec5f570bf" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ed81d1fb-cd80-4d94-97de-e9c5de2885bb tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "cinder-quobyte-d20fc1b5-c2c8-402c-846c-b75ec5f570bf" acquired by "delete_volume" :: waited 0.026s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:23 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[811dd553-a25e-4430-8d4c-bbacf958881a]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:21:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ed81d1fb-cd80-4d94-97de-e9c5de2885bb tempest-TestInstancesWithCinderVolumes-1017353710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d20fc1b5-c2c8-402c-846c-b75ec5f570bf {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:23 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d20fc1b5-c2c8-402c-846c-b75ec5f570bf Jul 22 12:21:23 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4571bbc5-22e5-4588-a24c-b13bc8851b8d tempest-CinderUnicodeTest-2091821831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4571bbc5-22e5-4588-a24c-b13bc8851b8d tempest-CinderUnicodeTest-2091821831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:21:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:21:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:21:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-4571bbc5-22e5-4588-a24c-b13bc8851b8d tempest-CinderUnicodeTest-2091821831 None] Creating offline snapshot f76f0fab-7f3e-417d-8ab0-f0aa747f3078 of volume 08d07559-b2bd-4b64-87f3-a8672b39ecda {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:21:24 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:21:24 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:24 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca662c34-ea0d-4273-90f2-1bc998c261bc]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:21:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4571bbc5-22e5-4588-a24c-b13bc8851b8d tempest-CinderUnicodeTest-2091821831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:24 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ed81d1fb-cd80-4d94-97de-e9c5de2885bb tempest-TestInstancesWithCinderVolumes-1017353710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d20fc1b5-c2c8-402c-846c-b75ec5f570bf" returned: 0 in 0.959s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ed81d1fb-cd80-4d94-97de-e9c5de2885bb tempest-TestInstancesWithCinderVolumes-1017353710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d20fc1b5-c2c8-402c-846c-b75ec5f570bf {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:24 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d20fc1b5-c2c8-402c-846c-b75ec5f570bf Jul 22 12:21:24 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:24 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda Jul 22 12:21:24 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:25 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ed81d1fb-cd80-4d94-97de-e9c5de2885bb tempest-TestInstancesWithCinderVolumes-1017353710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d20fc1b5-c2c8-402c-846c-b75ec5f570bf" returned: 0 in 0.563s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:25 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ed81d1fb-cd80-4d94-97de-e9c5de2885bb tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "cinder-quobyte-d20fc1b5-c2c8-402c-846c-b75ec5f570bf" released by "delete_volume" :: held 1.727s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:25 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.819s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:25 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:21:25 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:21:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread count: 28 {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:21:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread info: [<_MainThread(MainThread, started 137793405739136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:21:25 devstack cinder-volume[87568]: WARNING cinder.quota [None req-ed81d1fb-cd80-4d94-97de-e9c5de2885bb tempest-TestInstancesWithCinderVolumes-1017353710 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1240651134-741583179 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1240651134-741583179, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:21:25 devstack cinder-volume[87568]: WARNING cinder.quota [None req-ed81d1fb-cd80-4d94-97de-e9c5de2885bb tempest-TestInstancesWithCinderVolumes-1017353710 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1240651134-741583179 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1240651134-741583179, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:21:25 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-ed81d1fb-cd80-4d94-97de-e9c5de2885bb tempest-TestInstancesWithCinderVolumes-1017353710 None] Created reservations ['b44df302-45f9-41a2-8557-337fade53939', '361a4832-ff20-41f8-a10c-daf8abf30f0f', 'a4594a67-5a8a-46fc-b86a-78af89f7b0da', '7659da8d-5600-4648-9fd4-e89652e36e16'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:21:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ed81d1fb-cd80-4d94-97de-e9c5de2885bb tempest-TestInstancesWithCinderVolumes-1017353710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ed81d1fb-cd80-4d94-97de-e9c5de2885bb tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ed81d1fb-cd80-4d94-97de-e9c5de2885bb tempest-TestInstancesWithCinderVolumes-1017353710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:21:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ed81d1fb-cd80-4d94-97de-e9c5de2885bb tempest-TestInstancesWithCinderVolumes-1017353710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:21:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ed81d1fb-cd80-4d94-97de-e9c5de2885bb tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ed81d1fb-cd80-4d94-97de-e9c5de2885bb tempest-TestInstancesWithCinderVolumes-1017353710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:25 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:21:25 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:25 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4571bbc5-22e5-4588-a24c-b13bc8851b8d tempest-CinderUnicodeTest-2091821831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda" returned: 0 in 1.124s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4571bbc5-22e5-4588-a24c-b13bc8851b8d tempest-CinderUnicodeTest-2091821831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.f76f0fab-7f3e-417d-8ab0-f0aa747f3078 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:25 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.f76f0fab-7f3e-417d-8ab0-f0aa747f3078 1G Jul 22 12:21:25 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:26 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ed81d1fb-cd80-4d94-97de-e9c5de2885bb tempest-TestInstancesWithCinderVolumes-1017353710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.460s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:26 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-ed81d1fb-cd80-4d94-97de-e9c5de2885bb tempest-TestInstancesWithCinderVolumes-1017353710 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:21:26 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-ed81d1fb-cd80-4d94-97de-e9c5de2885bb tempest-TestInstancesWithCinderVolumes-1017353710 None] Deleted volume successfully. Jul 22 12:21:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ed81d1fb-cd80-4d94-97de-e9c5de2885bb tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "cinder-d20fc1b5-c2c8-402c-846c-b75ec5f570bf-delete_volume" released by "delete_volume" :: held 2.794s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:26 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4571bbc5-22e5-4588-a24c-b13bc8851b8d tempest-CinderUnicodeTest-2091821831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.f76f0fab-7f3e-417d-8ab0-f0aa747f3078 1G" returned: 0 in 1.003s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4571bbc5-22e5-4588-a24c-b13bc8851b8d tempest-CinderUnicodeTest-2091821831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08d07559-b2bd-4b64-87f3-a8672b39ecda -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.f76f0fab-7f3e-417d-8ab0-f0aa747f3078 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:26 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08d07559-b2bd-4b64-87f3-a8672b39ecda -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.f76f0fab-7f3e-417d-8ab0-f0aa747f3078 Jul 22 12:21:26 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:27 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4571bbc5-22e5-4588-a24c-b13bc8851b8d tempest-CinderUnicodeTest-2091821831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08d07559-b2bd-4b64-87f3-a8672b39ecda -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.f76f0fab-7f3e-417d-8ab0-f0aa747f3078" returned: 0 in 0.558s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:27 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-4571bbc5-22e5-4588-a24c-b13bc8851b8d tempest-CinderUnicodeTest-2091821831 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.f76f0fab-7f3e-417d-8ab0-f0aa747f3078 is being set with open permissions: ugo+rw Jul 22 12:21:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4571bbc5-22e5-4588-a24c-b13bc8851b8d tempest-CinderUnicodeTest-2091821831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.f76f0fab-7f3e-417d-8ab0-f0aa747f3078 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:27 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.f76f0fab-7f3e-417d-8ab0-f0aa747f3078 Jul 22 12:21:27 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:27 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4571bbc5-22e5-4588-a24c-b13bc8851b8d tempest-CinderUnicodeTest-2091821831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.f76f0fab-7f3e-417d-8ab0-f0aa747f3078" returned: 0 in 0.371s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4571bbc5-22e5-4588-a24c-b13bc8851b8d tempest-CinderUnicodeTest-2091821831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:27 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.info Jul 22 12:21:27 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:28 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4571bbc5-22e5-4588-a24c-b13bc8851b8d tempest-CinderUnicodeTest-2091821831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.info" returned: 0 in 0.370s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:28 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-4571bbc5-22e5-4588-a24c-b13bc8851b8d tempest-CinderUnicodeTest-2091821831 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.info is being set with open permissions: ugo+rw Jul 22 12:21:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4571bbc5-22e5-4588-a24c-b13bc8851b8d tempest-CinderUnicodeTest-2091821831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:28 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.info Jul 22 12:21:28 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:28 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4571bbc5-22e5-4588-a24c-b13bc8851b8d tempest-CinderUnicodeTest-2091821831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.info" returned: 0 in 0.311s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4571bbc5-22e5-4588-a24c-b13bc8851b8d tempest-CinderUnicodeTest-2091821831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.973s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:28 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-4571bbc5-22e5-4588-a24c-b13bc8851b8d tempest-CinderUnicodeTest-2091821831 None] Create snapshot completed successfully Jul 22 12:21:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-cf3fecb6-105f-4edc-b9d5-162cceddd202 tempest-CinderUnicodeTest-2091821831 None] Acquiring lock "cinder-f76f0fab-7f3e-417d-8ab0-f0aa747f3078-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-cf3fecb6-105f-4edc-b9d5-162cceddd202 tempest-CinderUnicodeTest-2091821831 None] Lock "cinder-f76f0fab-7f3e-417d-8ab0-f0aa747f3078-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-cf3fecb6-105f-4edc-b9d5-162cceddd202 tempest-CinderUnicodeTest-2091821831 None] Acquiring lock "cinder-quobyte-08d07559-b2bd-4b64-87f3-a8672b39ecda" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-cf3fecb6-105f-4edc-b9d5-162cceddd202 tempest-CinderUnicodeTest-2091821831 None] Lock "cinder-quobyte-08d07559-b2bd-4b64-87f3-a8672b39ecda" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-cf3fecb6-105f-4edc-b9d5-162cceddd202 tempest-CinderUnicodeTest-2091821831 None] Acquiring lock "cinder-quobyte-f76f0fab-7f3e-417d-8ab0-f0aa747f3078" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-cf3fecb6-105f-4edc-b9d5-162cceddd202 tempest-CinderUnicodeTest-2091821831 None] Lock "cinder-quobyte-f76f0fab-7f3e-417d-8ab0-f0aa747f3078" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-cf3fecb6-105f-4edc-b9d5-162cceddd202 tempest-CinderUnicodeTest-2091821831 None] Deleting offline snapshot f76f0fab-7f3e-417d-8ab0-f0aa747f3078 of volume 08d07559-b2bd-4b64-87f3-a8672b39ecda {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:21:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-cf3fecb6-105f-4edc-b9d5-162cceddd202 tempest-CinderUnicodeTest-2091821831 None] snapshot_file for this snap is: volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.f76f0fab-7f3e-417d-8ab0-f0aa747f3078 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:21:28 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6625a0-9bec-4f71-bcb4-7289bad55b41]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:21:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-cf3fecb6-105f-4edc-b9d5-162cceddd202 tempest-CinderUnicodeTest-2091821831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.f76f0fab-7f3e-417d-8ab0-f0aa747f3078 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:29 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.f76f0fab-7f3e-417d-8ab0-f0aa747f3078 Jul 22 12:21:29 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:29 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-cf3fecb6-105f-4edc-b9d5-162cceddd202 tempest-CinderUnicodeTest-2091821831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.f76f0fab-7f3e-417d-8ab0-f0aa747f3078" returned: 0 in 0.581s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-cf3fecb6-105f-4edc-b9d5-162cceddd202 tempest-CinderUnicodeTest-2091821831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08d07559-b2bd-4b64-87f3-a8672b39ecda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:21:29 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c813a7d-3dc2-4ca0-8fbd-67b657218f3d]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:21:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-cf3fecb6-105f-4edc-b9d5-162cceddd202 tempest-CinderUnicodeTest-2091821831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:29 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-e27727a0-4889-48e1-8aa9-c8acc8f98e85 req-0a1305ec-310a-4b18-8ba3-f628eb2173d6 tempest-TestInstancesWithCinderVolumes-1017353710 None] Terminate volume connection completed successfully. Jul 22 12:21:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-e27727a0-4889-48e1-8aa9-c8acc8f98e85 req-0a1305ec-310a-4b18-8ba3-f628eb2173d6 tempest-TestInstancesWithCinderVolumes-1017353710 None] Deleting attachment f568911c-45c9-4007-8d11-a48217df477f. {{(pid=87568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 12:21:29 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda Jul 22 12:21:29 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:30 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-cf3fecb6-105f-4edc-b9d5-162cceddd202 tempest-CinderUnicodeTest-2091821831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda" returned: 0 in 0.521s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-cf3fecb6-105f-4edc-b9d5-162cceddd202 tempest-CinderUnicodeTest-2091821831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.f76f0fab-7f3e-417d-8ab0-f0aa747f3078 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:30 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.f76f0fab-7f3e-417d-8ab0-f0aa747f3078 Jul 22 12:21:30 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0747a250-a8c6-427c-b7ab-bdffd2f12519 tempest-TestInstancesWithCinderVolumes-1017353710 None] Acquiring lock "cinder-d62eb484-642b-4dd4-8086-94bba1a93b9e-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0747a250-a8c6-427c-b7ab-bdffd2f12519 tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "cinder-d62eb484-642b-4dd4-8086-94bba1a93b9e-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0747a250-a8c6-427c-b7ab-bdffd2f12519 tempest-TestInstancesWithCinderVolumes-1017353710 None] Acquiring lock "cinder-quobyte-d62eb484-642b-4dd4-8086-94bba1a93b9e" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0747a250-a8c6-427c-b7ab-bdffd2f12519 tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "cinder-quobyte-d62eb484-642b-4dd4-8086-94bba1a93b9e" acquired by "delete_volume" :: waited 0.027s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:30 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[63da7d83-5760-4d31-826b-8104ab3d92ec]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:21:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0747a250-a8c6-427c-b7ab-bdffd2f12519 tempest-TestInstancesWithCinderVolumes-1017353710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d62eb484-642b-4dd4-8086-94bba1a93b9e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:30 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d62eb484-642b-4dd4-8086-94bba1a93b9e Jul 22 12:21:30 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:30 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-cf3fecb6-105f-4edc-b9d5-162cceddd202 tempest-CinderUnicodeTest-2091821831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.f76f0fab-7f3e-417d-8ab0-f0aa747f3078" returned: 0 in 0.614s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-cf3fecb6-105f-4edc-b9d5-162cceddd202 tempest-CinderUnicodeTest-2091821831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.f76f0fab-7f3e-417d-8ab0-f0aa747f3078 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:30 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.f76f0fab-7f3e-417d-8ab0-f0aa747f3078 Jul 22 12:21:30 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:31 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:31 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-cf3fecb6-105f-4edc-b9d5-162cceddd202 tempest-CinderUnicodeTest-2091821831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda.f76f0fab-7f3e-417d-8ab0-f0aa747f3078" returned: 0 in 0.583s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0747a250-a8c6-427c-b7ab-bdffd2f12519 tempest-TestInstancesWithCinderVolumes-1017353710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d62eb484-642b-4dd4-8086-94bba1a93b9e" returned: 0 in 0.792s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0747a250-a8c6-427c-b7ab-bdffd2f12519 tempest-TestInstancesWithCinderVolumes-1017353710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d62eb484-642b-4dd4-8086-94bba1a93b9e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:31 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d62eb484-642b-4dd4-8086-94bba1a93b9e Jul 22 12:21:31 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-cf3fecb6-105f-4edc-b9d5-162cceddd202 tempest-CinderUnicodeTest-2091821831 None] Lock "cinder-quobyte-f76f0fab-7f3e-417d-8ab0-f0aa747f3078" released by "_delete_snapshot" :: held 2.586s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-cf3fecb6-105f-4edc-b9d5-162cceddd202 tempest-CinderUnicodeTest-2091821831 None] Lock "cinder-quobyte-08d07559-b2bd-4b64-87f3-a8672b39ecda" released by "delete_snapshot" :: held 2.634s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:31 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-cf3fecb6-105f-4edc-b9d5-162cceddd202 tempest-CinderUnicodeTest-2091821831 None] Created reservations ['3ad1bdcd-6066-4ae2-be0c-7c580c21cac0', '9f227839-0b2c-4aed-b142-3e7c82703bf0', '2173f6f1-021f-4c0f-a9be-b8368211e663', '2ed2b425-09a6-4cf2-8386-19f39554713e'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:21:31 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0747a250-a8c6-427c-b7ab-bdffd2f12519 tempest-TestInstancesWithCinderVolumes-1017353710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d62eb484-642b-4dd4-8086-94bba1a93b9e" returned: 0 in 0.450s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0747a250-a8c6-427c-b7ab-bdffd2f12519 tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "cinder-quobyte-d62eb484-642b-4dd4-8086-94bba1a93b9e" released by "delete_volume" :: held 1.330s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:31 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-cf3fecb6-105f-4edc-b9d5-162cceddd202 tempest-CinderUnicodeTest-2091821831 None] Delete snapshot completed successfully. Jul 22 12:21:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-cf3fecb6-105f-4edc-b9d5-162cceddd202 tempest-CinderUnicodeTest-2091821831 None] Lock "cinder-f76f0fab-7f3e-417d-8ab0-f0aa747f3078-delete_snapshot" released by "delete_snapshot" :: held 3.046s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:31 devstack cinder-volume[87568]: WARNING cinder.quota [None req-0747a250-a8c6-427c-b7ab-bdffd2f12519 tempest-TestInstancesWithCinderVolumes-1017353710 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1455556965-704650118 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1455556965-704650118, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:21:31 devstack cinder-volume[87568]: WARNING cinder.quota [None req-0747a250-a8c6-427c-b7ab-bdffd2f12519 tempest-TestInstancesWithCinderVolumes-1017353710 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1455556965-704650118 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1455556965-704650118, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:21:31 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-0747a250-a8c6-427c-b7ab-bdffd2f12519 tempest-TestInstancesWithCinderVolumes-1017353710 None] Created reservations ['23ce6ddd-a779-4764-941a-08314ab89168', '3360b108-e546-47dc-a8f7-7a9090020a46', '54bb0095-3ae9-4f55-be0f-28f51620805c', 'fa907fb8-368e-4da3-9f9f-81e98eb6d97d'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:21:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-315edf03-915c-452a-9ed0-8693fd017ae4 tempest-CinderUnicodeTest-2091821831 None] Acquiring lock "cinder-08d07559-b2bd-4b64-87f3-a8672b39ecda-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0747a250-a8c6-427c-b7ab-bdffd2f12519 tempest-TestInstancesWithCinderVolumes-1017353710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0747a250-a8c6-427c-b7ab-bdffd2f12519 tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0747a250-a8c6-427c-b7ab-bdffd2f12519 tempest-TestInstancesWithCinderVolumes-1017353710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:21:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0747a250-a8c6-427c-b7ab-bdffd2f12519 tempest-TestInstancesWithCinderVolumes-1017353710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:21:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0747a250-a8c6-427c-b7ab-bdffd2f12519 tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0747a250-a8c6-427c-b7ab-bdffd2f12519 tempest-TestInstancesWithCinderVolumes-1017353710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-315edf03-915c-452a-9ed0-8693fd017ae4 tempest-CinderUnicodeTest-2091821831 None] Lock "cinder-08d07559-b2bd-4b64-87f3-a8672b39ecda-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:32 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:21:32 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-315edf03-915c-452a-9ed0-8693fd017ae4 tempest-CinderUnicodeTest-2091821831 None] Acquiring lock "cinder-quobyte-08d07559-b2bd-4b64-87f3-a8672b39ecda" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-315edf03-915c-452a-9ed0-8693fd017ae4 tempest-CinderUnicodeTest-2091821831 None] Lock "cinder-quobyte-08d07559-b2bd-4b64-87f3-a8672b39ecda" acquired by "delete_volume" :: waited 0.042s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:32 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55e6647-e380-441f-9f98-21412473bb76]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:21:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-315edf03-915c-452a-9ed0-8693fd017ae4 tempest-CinderUnicodeTest-2091821831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:32 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0747a250-a8c6-427c-b7ab-bdffd2f12519 tempest-TestInstancesWithCinderVolumes-1017353710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.696s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:32 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0747a250-a8c6-427c-b7ab-bdffd2f12519 tempest-TestInstancesWithCinderVolumes-1017353710 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:21:32 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-0747a250-a8c6-427c-b7ab-bdffd2f12519 tempest-TestInstancesWithCinderVolumes-1017353710 None] Deleted volume successfully. Jul 22 12:21:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0747a250-a8c6-427c-b7ab-bdffd2f12519 tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "cinder-d62eb484-642b-4dd4-8086-94bba1a93b9e-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:32 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda Jul 22 12:21:32 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:33 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-315edf03-915c-452a-9ed0-8693fd017ae4 tempest-CinderUnicodeTest-2091821831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda" returned: 0 in 1.135s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-315edf03-915c-452a-9ed0-8693fd017ae4 tempest-CinderUnicodeTest-2091821831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:33 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda Jul 22 12:21:33 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:34 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-315edf03-915c-452a-9ed0-8693fd017ae4 tempest-CinderUnicodeTest-2091821831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-08d07559-b2bd-4b64-87f3-a8672b39ecda" returned: 0 in 0.560s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-315edf03-915c-452a-9ed0-8693fd017ae4 tempest-CinderUnicodeTest-2091821831 None] Lock "cinder-quobyte-08d07559-b2bd-4b64-87f3-a8672b39ecda" released by "delete_volume" :: held 1.868s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:34 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-315edf03-915c-452a-9ed0-8693fd017ae4 tempest-CinderUnicodeTest-2091821831 None] Created reservations ['ae982ec8-f3ee-4ec2-8174-31abb2314ee1', 'f2e6dab1-d5ce-4e1f-87ca-7fe579827b6e', '3d8dadc7-3c5c-4c3a-89c1-242708686511', 'a1eb3f1d-4d06-41a2-891c-5c17c4ff27a7'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:21:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-315edf03-915c-452a-9ed0-8693fd017ae4 tempest-CinderUnicodeTest-2091821831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-315edf03-915c-452a-9ed0-8693fd017ae4 tempest-CinderUnicodeTest-2091821831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-315edf03-915c-452a-9ed0-8693fd017ae4 tempest-CinderUnicodeTest-2091821831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:21:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-315edf03-915c-452a-9ed0-8693fd017ae4 tempest-CinderUnicodeTest-2091821831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:21:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-315edf03-915c-452a-9ed0-8693fd017ae4 tempest-CinderUnicodeTest-2091821831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-315edf03-915c-452a-9ed0-8693fd017ae4 tempest-CinderUnicodeTest-2091821831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:34 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:21:34 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:34 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-315edf03-915c-452a-9ed0-8693fd017ae4 tempest-CinderUnicodeTest-2091821831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.321s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:34 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-315edf03-915c-452a-9ed0-8693fd017ae4 tempest-CinderUnicodeTest-2091821831 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:21:34 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-315edf03-915c-452a-9ed0-8693fd017ae4 tempest-CinderUnicodeTest-2091821831 None] Deleted volume successfully. Jul 22 12:21:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-315edf03-915c-452a-9ed0-8693fd017ae4 tempest-CinderUnicodeTest-2091821831 None] Lock "cinder-08d07559-b2bd-4b64-87f3-a8672b39ecda-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a7bfbf53-b4ac-46b5-a7c9-d3f7f8d9668b tempest-CinderUnicodeTest-2091821831 None] Acquiring lock "cinder-19e8e47d-73a7-47f1-bf21-e92b4d13fd44-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a7bfbf53-b4ac-46b5-a7c9-d3f7f8d9668b tempest-CinderUnicodeTest-2091821831 None] Lock "cinder-19e8e47d-73a7-47f1-bf21-e92b4d13fd44-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a7bfbf53-b4ac-46b5-a7c9-d3f7f8d9668b tempest-CinderUnicodeTest-2091821831 None] Acquiring lock "cinder-quobyte-19e8e47d-73a7-47f1-bf21-e92b4d13fd44" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:35 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a7bfbf53-b4ac-46b5-a7c9-d3f7f8d9668b tempest-CinderUnicodeTest-2091821831 None] Lock "cinder-quobyte-19e8e47d-73a7-47f1-bf21-e92b4d13fd44" acquired by "delete_volume" :: waited 0.032s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:35 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d97e2f5-0cf6-47f5-aeee-1dfe61cba8dc]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:21:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a7bfbf53-b4ac-46b5-a7c9-d3f7f8d9668b tempest-CinderUnicodeTest-2091821831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19e8e47d-73a7-47f1-bf21-e92b4d13fd44 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:36 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19e8e47d-73a7-47f1-bf21-e92b4d13fd44 Jul 22 12:21:36 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:36 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a7bfbf53-b4ac-46b5-a7c9-d3f7f8d9668b tempest-CinderUnicodeTest-2091821831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19e8e47d-73a7-47f1-bf21-e92b4d13fd44" returned: 0 in 0.777s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a7bfbf53-b4ac-46b5-a7c9-d3f7f8d9668b tempest-CinderUnicodeTest-2091821831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19e8e47d-73a7-47f1-bf21-e92b4d13fd44 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:36 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19e8e47d-73a7-47f1-bf21-e92b4d13fd44 Jul 22 12:21:36 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:37 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a7bfbf53-b4ac-46b5-a7c9-d3f7f8d9668b tempest-CinderUnicodeTest-2091821831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-19e8e47d-73a7-47f1-bf21-e92b4d13fd44" returned: 0 in 0.637s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a7bfbf53-b4ac-46b5-a7c9-d3f7f8d9668b tempest-CinderUnicodeTest-2091821831 None] Lock "cinder-quobyte-19e8e47d-73a7-47f1-bf21-e92b4d13fd44" released by "delete_volume" :: held 1.551s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:37 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-a7bfbf53-b4ac-46b5-a7c9-d3f7f8d9668b tempest-CinderUnicodeTest-2091821831 None] Created reservations ['f85d62c7-ff0f-4b5e-9cae-5e17f177ea23', 'c65abb46-e10f-4d7e-bead-4e27bd4bafdf', '71f36987-f923-4fd1-abdb-72d016d426d3', '7e042f8a-80ab-42b3-a7a5-cad4fe9c6176'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:21:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a7bfbf53-b4ac-46b5-a7c9-d3f7f8d9668b tempest-CinderUnicodeTest-2091821831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a7bfbf53-b4ac-46b5-a7c9-d3f7f8d9668b tempest-CinderUnicodeTest-2091821831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a7bfbf53-b4ac-46b5-a7c9-d3f7f8d9668b tempest-CinderUnicodeTest-2091821831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:21:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a7bfbf53-b4ac-46b5-a7c9-d3f7f8d9668b tempest-CinderUnicodeTest-2091821831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:21:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a7bfbf53-b4ac-46b5-a7c9-d3f7f8d9668b tempest-CinderUnicodeTest-2091821831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a7bfbf53-b4ac-46b5-a7c9-d3f7f8d9668b tempest-CinderUnicodeTest-2091821831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:37 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:21:37 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:38 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a7bfbf53-b4ac-46b5-a7c9-d3f7f8d9668b tempest-CinderUnicodeTest-2091821831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.442s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:38 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-a7bfbf53-b4ac-46b5-a7c9-d3f7f8d9668b tempest-CinderUnicodeTest-2091821831 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:21:38 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-a7bfbf53-b4ac-46b5-a7c9-d3f7f8d9668b tempest-CinderUnicodeTest-2091821831 None] Deleted volume successfully. Jul 22 12:21:38 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a7bfbf53-b4ac-46b5-a7c9-d3f7f8d9668b tempest-CinderUnicodeTest-2091821831 None] Lock "cinder-19e8e47d-73a7-47f1-bf21-e92b4d13fd44-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:38 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-bb8f72ea-cd07-45a4-9ab7-c75ba283ad5b req-1e13ff00-dc15-4d1c-9ec1-6d52f04ba40b tempest-TestInstancesWithCinderVolumes-1017353710 None] Terminate volume connection completed successfully. Jul 22 12:21:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-bb8f72ea-cd07-45a4-9ab7-c75ba283ad5b req-1e13ff00-dc15-4d1c-9ec1-6d52f04ba40b tempest-TestInstancesWithCinderVolumes-1017353710 None] Deleting attachment 284716a4-83b7-471d-a2ce-f6a72f9ccb85. {{(pid=87568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 12:21:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-765b4085-430e-4498-baa3-3d8002c57fd5 tempest-TestInstancesWithCinderVolumes-1017353710 None] Acquiring lock "cinder-4d658afb-b21c-410a-9697-27d2be2fae62-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-765b4085-430e-4498-baa3-3d8002c57fd5 tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "cinder-4d658afb-b21c-410a-9697-27d2be2fae62-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-765b4085-430e-4498-baa3-3d8002c57fd5 tempest-TestInstancesWithCinderVolumes-1017353710 None] Acquiring lock "cinder-quobyte-4d658afb-b21c-410a-9697-27d2be2fae62" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:21:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-765b4085-430e-4498-baa3-3d8002c57fd5 tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "cinder-quobyte-4d658afb-b21c-410a-9697-27d2be2fae62" acquired by "delete_volume" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:21:40 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a3495a-689f-471d-a6af-b1b999b9969b]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:21:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-765b4085-430e-4498-baa3-3d8002c57fd5 tempest-TestInstancesWithCinderVolumes-1017353710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d658afb-b21c-410a-9697-27d2be2fae62 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:40 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d658afb-b21c-410a-9697-27d2be2fae62 Jul 22 12:21:40 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:40 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-765b4085-430e-4498-baa3-3d8002c57fd5 tempest-TestInstancesWithCinderVolumes-1017353710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d658afb-b21c-410a-9697-27d2be2fae62" returned: 0 in 0.409s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-765b4085-430e-4498-baa3-3d8002c57fd5 tempest-TestInstancesWithCinderVolumes-1017353710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d658afb-b21c-410a-9697-27d2be2fae62 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:40 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d658afb-b21c-410a-9697-27d2be2fae62 Jul 22 12:21:40 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:40 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-765b4085-430e-4498-baa3-3d8002c57fd5 tempest-TestInstancesWithCinderVolumes-1017353710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4d658afb-b21c-410a-9697-27d2be2fae62" returned: 0 in 0.274s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-765b4085-430e-4498-baa3-3d8002c57fd5 tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "cinder-quobyte-4d658afb-b21c-410a-9697-27d2be2fae62" released by "delete_volume" :: held 0.738s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:40 devstack cinder-volume[87568]: WARNING cinder.quota [None req-765b4085-430e-4498-baa3-3d8002c57fd5 tempest-TestInstancesWithCinderVolumes-1017353710 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-105001549-1094673365 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-105001549-1094673365, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:21:40 devstack cinder-volume[87568]: WARNING cinder.quota [None req-765b4085-430e-4498-baa3-3d8002c57fd5 tempest-TestInstancesWithCinderVolumes-1017353710 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-105001549-1094673365 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-105001549-1094673365, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:21:40 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-765b4085-430e-4498-baa3-3d8002c57fd5 tempest-TestInstancesWithCinderVolumes-1017353710 None] Created reservations ['ef3419c0-abc7-4960-a3ed-ee70918d3d10', '238ea865-7364-4257-b2ba-026c09a75fda', '0768ecd8-46e0-4c7e-b003-f819a39a09c0', 'e791c7f3-1a44-4d88-a6a1-4eb1d0aa51ba'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:21:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-765b4085-430e-4498-baa3-3d8002c57fd5 tempest-TestInstancesWithCinderVolumes-1017353710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-765b4085-430e-4498-baa3-3d8002c57fd5 tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-765b4085-430e-4498-baa3-3d8002c57fd5 tempest-TestInstancesWithCinderVolumes-1017353710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:21:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-765b4085-430e-4498-baa3-3d8002c57fd5 tempest-TestInstancesWithCinderVolumes-1017353710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:21:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-765b4085-430e-4498-baa3-3d8002c57fd5 tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-765b4085-430e-4498-baa3-3d8002c57fd5 tempest-TestInstancesWithCinderVolumes-1017353710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:21:41 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:21:41 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:21:41 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Jul 22 12:21:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-765b4085-430e-4498-baa3-3d8002c57fd5 tempest-TestInstancesWithCinderVolumes-1017353710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.272s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:21:41 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-765b4085-430e-4498-baa3-3d8002c57fd5 tempest-TestInstancesWithCinderVolumes-1017353710 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:21:41 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-765b4085-430e-4498-baa3-3d8002c57fd5 tempest-TestInstancesWithCinderVolumes-1017353710 None] Deleted volume successfully. Jul 22 12:21:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-765b4085-430e-4498-baa3-3d8002c57fd5 tempest-TestInstancesWithCinderVolumes-1017353710 None] Lock "cinder-4d658afb-b21c-410a-9697-27d2be2fae62-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:21:51 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:UPDATE=127,cinder:SELECT=101,cinder:INSERT=28,cinder:DELETE=9 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:21:51 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:UPDATE=64,cinder:SELECT=57,cinder:INSERT=15,cinder:DELETE=3 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:21:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-606f36a8-7843-46f3-b6cd-749a690a4578 req-d501df4b-21c4-4c50-a0b0-93bc59555e7a tempest-TestStampPattern-738882885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-606f36a8-7843-46f3-b6cd-749a690a4578 req-d501df4b-21c4-4c50-a0b0-93bc59555e7a tempest-TestStampPattern-738882885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-606f36a8-7843-46f3-b6cd-749a690a4578 req-d501df4b-21c4-4c50-a0b0-93bc59555e7a tempest-TestStampPattern-738882885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:21:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-606f36a8-7843-46f3-b6cd-749a690a4578 req-d501df4b-21c4-4c50-a0b0-93bc59555e7a tempest-TestStampPattern-738882885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29', 'name': 'volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c90ff9cd-845b-4156-8c18-bc43e01eebf9', 'enforce_multipath': True} {{(pid=87568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 12:21:52 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-606f36a8-7843-46f3-b6cd-749a690a4578 req-d501df4b-21c4-4c50-a0b0-93bc59555e7a tempest-TestStampPattern-738882885 None] attachment_update completed successfully. Jul 22 12:21:59 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-9769f16b-ab38-4f89-a990-ab28cb7d99f0 req-5c16af92-d2c5-4dc3-acc6-5951e097b96f tempest-TestStampPattern-738882885 None] Terminate volume connection completed successfully. Jul 22 12:21:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-9769f16b-ab38-4f89-a990-ab28cb7d99f0 req-5c16af92-d2c5-4dc3-acc6-5951e097b96f tempest-TestStampPattern-738882885 None] Deleting attachment c90ff9cd-845b-4156-8c18-bc43e01eebf9. {{(pid=87568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 12:21:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d3605999-1011-4f6c-896d-b29d7ec44202 tempest-TestStampPattern-738882885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:21:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d3605999-1011-4f6c-896d-b29d7ec44202 tempest-TestStampPattern-738882885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:21:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-d3605999-1011-4f6c-896d-b29d7ec44202 tempest-TestStampPattern-738882885 None] Creating offline snapshot aefec434-aea7-4288-8ed5-88774cd0ff0b of volume 6a62544e-f9d1-47b7-894d-b05d5f4fa86c {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:22:00 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd09330-9eaa-42c8-90ff-2a4906c0ec37]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:22:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d3605999-1011-4f6c-896d-b29d7ec44202 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:00 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c Jul 22 12:22:00 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:00 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d3605999-1011-4f6c-896d-b29d7ec44202 tempest-TestStampPattern-738882885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c" returned: 0 in 0.445s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d3605999-1011-4f6c-896d-b29d7ec44202 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:00 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b 1G Jul 22 12:22:00 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:00 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d3605999-1011-4f6c-896d-b29d7ec44202 tempest-TestStampPattern-738882885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b 1G" returned: 0 in 0.490s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d3605999-1011-4f6c-896d-b29d7ec44202 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:00 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b Jul 22 12:22:00 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:01 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d3605999-1011-4f6c-896d-b29d7ec44202 tempest-TestStampPattern-738882885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b" returned: 0 in 0.359s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:01 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-d3605999-1011-4f6c-896d-b29d7ec44202 tempest-TestStampPattern-738882885 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b is being set with open permissions: ugo+rw Jul 22 12:22:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d3605999-1011-4f6c-896d-b29d7ec44202 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:01 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b Jul 22 12:22:01 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:01 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d3605999-1011-4f6c-896d-b29d7ec44202 tempest-TestStampPattern-738882885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b" returned: 0 in 0.283s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d3605999-1011-4f6c-896d-b29d7ec44202 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:01 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.info Jul 22 12:22:01 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:01 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d3605999-1011-4f6c-896d-b29d7ec44202 tempest-TestStampPattern-738882885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.info" returned: 0 in 0.290s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:01 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-d3605999-1011-4f6c-896d-b29d7ec44202 tempest-TestStampPattern-738882885 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.info is being set with open permissions: ugo+rw Jul 22 12:22:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d3605999-1011-4f6c-896d-b29d7ec44202 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:01 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.info Jul 22 12:22:01 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:02 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d3605999-1011-4f6c-896d-b29d7ec44202 tempest-TestStampPattern-738882885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.info" returned: 0 in 0.277s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d3605999-1011-4f6c-896d-b29d7ec44202 tempest-TestStampPattern-738882885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.265s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:22:02 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d3605999-1011-4f6c-896d-b29d7ec44202 tempest-TestStampPattern-738882885 None] Create snapshot completed successfully Jul 22 12:22:07 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:22:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Flow 'volume_create_manager' (0df9eda4-18c9-4edd-9728-b192b334972e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:22:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b89a8e-7a75-45c8-8311-82bd6e3f02b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b89a8e-7a75-45c8-8311-82bd6e3f02b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-528871375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=139ee7cf-030d-4ddb-925a-db904050633d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e5a120b6b054352a6079b8499dcc03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:22:08Z,use_quota=True,user_id='4f6afbe12a06454b81842d9c196184f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6325b0af-0f97-4e0e-a8d5-20c3dfaae903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6325b0af-0f97-4e0e-a8d5-20c3dfaae903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb83802d-d0ac-40b5-acd4-d6d96f635c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb83802d-d0ac-40b5-acd4-d6d96f635c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '139ee7cf-030d-4ddb-925a-db904050633d', 'volume_name': 'volume-139ee7cf-030d-4ddb-925a-db904050633d', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c96b29-1784-4d55-b2df-51c676d9435e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c96b29-1784-4d55-b2df-51c676d9435e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa572b90-9bd0-4a92-8846-d7706c1e4fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:07 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Volume 139ee7cf-030d-4ddb-925a-db904050633d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-139ee7cf-030d-4ddb-925a-db904050633d', 'volume_size': 1} Jul 22 12:22:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:22:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:22:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-528871375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=139ee7cf-030d-4ddb-925a-db904050633d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e5a120b6b054352a6079b8499dcc03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:22:08Z,use_quota=True,user_id='4f6afbe12a06454b81842d9c196184f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:22:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Creating volume 139ee7cf-030d-4ddb-925a-db904050633d {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:22:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:22:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:22:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:22:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:22:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:22:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:22:07 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:22:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:07 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d 1073741824 Jul 22 12:22:07 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:08 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d 1073741824" returned: 0 in 0.609s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:08 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d Jul 22 12:22:08 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:08 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d" returned: 0 in 0.315s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:22:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:22:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa572b90-9bd0-4a92-8846-d7706c1e4fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-139ee7cf-030d-4ddb-925a-db904050633d', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93b4303-2070-4bb6-83cb-ab9a2a6d1708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:08 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Volume volume-139ee7cf-030d-4ddb-925a-db904050633d (139ee7cf-030d-4ddb-925a-db904050633d): created successfully Jul 22 12:22:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93b4303-2070-4bb6-83cb-ab9a2a6d1708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Flow 'volume_create_manager' (0df9eda4-18c9-4edd-9728-b192b334972e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:22:08 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-6ff2ae2b-e76e-441d-8832-73fb30832629 tempest-SnapshotDependencyTests-2081341525 None] Created volume successfully. Jul 22 12:22:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-071328e2-46b8-49a4-93de-8fe3ad928d12 tempest-SnapshotDependencyTests-2081341525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:22:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-071328e2-46b8-49a4-93de-8fe3ad928d12 tempest-SnapshotDependencyTests-2081341525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:22:10 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-071328e2-46b8-49a4-93de-8fe3ad928d12 tempest-SnapshotDependencyTests-2081341525 None] Creating offline snapshot 6bd83274-4991-43c4-a290-5b85cd474cbb of volume 139ee7cf-030d-4ddb-925a-db904050633d {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:22:10 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d9a4c4-0c6e-4984-9bf7-a29fc9b7e198]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:22:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-071328e2-46b8-49a4-93de-8fe3ad928d12 tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:10 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d Jul 22 12:22:10 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:10 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-071328e2-46b8-49a4-93de-8fe3ad928d12 tempest-SnapshotDependencyTests-2081341525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d" returned: 0 in 0.467s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-071328e2-46b8-49a4-93de-8fe3ad928d12 tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:10 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb 1G Jul 22 12:22:10 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:11 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-071328e2-46b8-49a4-93de-8fe3ad928d12 tempest-SnapshotDependencyTests-2081341525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb 1G" returned: 0 in 0.704s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-071328e2-46b8-49a4-93de-8fe3ad928d12 tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139ee7cf-030d-4ddb-925a-db904050633d -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:11 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139ee7cf-030d-4ddb-925a-db904050633d -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb Jul 22 12:22:11 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:11 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:22:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Flow 'volume_create_manager' (d77add37-ce1c-4c03-b2bb-03f4234a4c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:22:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b766b7c2-e760-4cf3-bcb6-13f283c8941e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b766b7c2-e760-4cf3-bcb6-13f283c8941e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-67325138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40518906-0710-42d9-84e3-34c422c16db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4b5eabefa994f4d9829e9845eb3d0b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aefec434-aea7-4288-8ed5-88774cd0ff0b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:22:12Z,use_quota=True,user_id='980f55cc14e24a61a819e9244bc16bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe11b5a-d605-4fdb-b80b-80533aa6a510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe11b5a-d605-4fdb-b80b-80533aa6a510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba026e70-5c75-4770-8a69-98897ac0160a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba026e70-5c75-4770-8a69-98897ac0160a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '40518906-0710-42d9-84e3-34c422c16db4', 'volume_name': 'volume-40518906-0710-42d9-84e3-34c422c16db4', 'volume_size': 1, 'snapshot_id': 'aefec434-aea7-4288-8ed5-88774cd0ff0b'}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33334376-c168-49b4-b487-d44051a0616d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33334376-c168-49b4-b487-d44051a0616d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f60101-0d64-4068-a0c4-2d46680a4040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:11 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Volume 40518906-0710-42d9-84e3-34c422c16db4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-40518906-0710-42d9-84e3-34c422c16db4', 'volume_size': 1, 'snapshot_id': 'aefec434-aea7-4288-8ed5-88774cd0ff0b'} Jul 22 12:22:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:22:11 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-071328e2-46b8-49a4-93de-8fe3ad928d12 tempest-SnapshotDependencyTests-2081341525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139ee7cf-030d-4ddb-925a-db904050633d -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb" returned: 0 in 0.439s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:11 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-071328e2-46b8-49a4-93de-8fe3ad928d12 tempest-SnapshotDependencyTests-2081341525 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb is being set with open permissions: ugo+rw Jul 22 12:22:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-071328e2-46b8-49a4-93de-8fe3ad928d12 tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:11 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb Jul 22 12:22:11 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:12 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-071328e2-46b8-49a4-93de-8fe3ad928d12 tempest-SnapshotDependencyTests-2081341525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb" returned: 0 in 0.326s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-071328e2-46b8-49a4-93de-8fe3ad928d12 tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:12 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.info Jul 22 12:22:12 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:12 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-071328e2-46b8-49a4-93de-8fe3ad928d12 tempest-SnapshotDependencyTests-2081341525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.info" returned: 0 in 0.364s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:12 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-071328e2-46b8-49a4-93de-8fe3ad928d12 tempest-SnapshotDependencyTests-2081341525 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.info is being set with open permissions: ugo+rw Jul 22 12:22:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-071328e2-46b8-49a4-93de-8fe3ad928d12 tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:12 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.info Jul 22 12:22:12 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:12 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-071328e2-46b8-49a4-93de-8fe3ad928d12 tempest-SnapshotDependencyTests-2081341525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.info" returned: 0 in 0.395s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-071328e2-46b8-49a4-93de-8fe3ad928d12 tempest-SnapshotDependencyTests-2081341525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.823s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.233s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Acquiring lock "cinder-quobyte-aefec434-aea7-4288-8ed5-88774cd0ff0b-40518906-0710-42d9-84e3-34c422c16db4" by "_create_volume_from_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Lock "cinder-quobyte-aefec434-aea7-4288-8ed5-88774cd0ff0b-40518906-0710-42d9-84e3-34c422c16db4" acquired by "_create_volume_from_snapshot" :: waited 0.059s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Creating volume 40518906-0710-42d9-84e3-34c422c16db4 from snapshot aefec434-aea7-4288-8ed5-88774cd0ff0b {{(pid=87568) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Acquiring lock "cinder-quobyte-40518906-0710-42d9-84e3-34c422c16db4" by "_copy_volume_from_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:22:13 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-071328e2-46b8-49a4-93de-8fe3ad928d12 tempest-SnapshotDependencyTests-2081341525 None] Create snapshot completed successfully Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Lock "cinder-quobyte-40518906-0710-42d9-84e3-34c422c16db4" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] snapshot: aefec434-aea7-4288-8ed5-88774cd0ff0b, volume: 40518906-0710-42d9-84e3-34c422c16db4, {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06c696f-7f87-4f46-855e-546a5a274a46]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:13 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b Jul 22 12:22:13 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:13 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b" returned: 0 in 0.634s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] will copy from snapshot at /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Creating direct copy from snapshot {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[367aeb56-5907-49e9-95be-eacac18313ad]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:22:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:14 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c Jul 22 12:22:14 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:14 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:22:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Flow 'volume_create_manager' (0e2432d1-8d24-4154-b987-2388d5f6ca64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:22:14 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e938e0fb-8c10-4fc9-8a8d-bc6ad72fa4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c" returned: 0 in 0.581s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:14 devstack cinder-volume[87568]: DEBUG cinder.utils [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Path /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-40518906-0710-42d9-84e3-34c422c16db4 not found in is_blk_device check {{(pid=87568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 12:22:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-40518906-0710-42d9-84e3-34c422c16db4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e938e0fb-8c10-4fc9-8a8d-bc6ad72fa4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e41be32-3d08-4459-8eae-887a9285a2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e5a120b6b054352a6079b8499dcc03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6bd83274-4991-43c4-a290-5b85cd474cbb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:22:14Z,use_quota=True,user_id='4f6afbe12a06454b81842d9c196184f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdbd2db8-6b1a-4389-9bad-993f0fda0c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdbd2db8-6b1a-4389-9bad-993f0fda0c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:14 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-40518906-0710-42d9-84e3-34c422c16db4 Jul 22 12:22:14 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3ce676-d00d-4498-b28f-97608d7d801a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3ce676-d00d-4498-b28f-97608d7d801a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1e41be32-3d08-4459-8eae-887a9285a2c3', 'volume_name': 'volume-1e41be32-3d08-4459-8eae-887a9285a2c3', 'volume_size': 1, 'snapshot_id': '6bd83274-4991-43c4-a290-5b85cd474cbb'}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce43426b-4f5b-4cad-85a7-35dac1eed4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce43426b-4f5b-4cad-85a7-35dac1eed4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ccc6691-8022-48ad-96d1-70c90dfdd81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:14 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Volume 1e41be32-3d08-4459-8eae-887a9285a2c3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1e41be32-3d08-4459-8eae-887a9285a2c3', 'volume_size': 1, 'snapshot_id': '6bd83274-4991-43c4-a290-5b85cd474cbb'} Jul 22 12:22:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:22:17 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-67888db9-291b-411f-bb00-f000646507a2 req-99539636-3026-4be7-af6a-01c58ccc0262 tempest-TestMinimumBasicScenario-436212127 None] Terminate volume connection completed successfully. Jul 22 12:22:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-67888db9-291b-411f-bb00-f000646507a2 req-99539636-3026-4be7-af6a-01c58ccc0262 tempest-TestMinimumBasicScenario-436212127 None] Deleting attachment b74f20d5-c75c-49bd-8c1f-d6c1cd080f3a. {{(pid=87568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 12:22:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d029d892-a6c4-48f2-9b91-1a809551e27b tempest-TestMinimumBasicScenario-436212127 None] Acquiring lock "cinder-93ad7495-e6e8-4939-98b7-4bce4bbac50c-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:22:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d029d892-a6c4-48f2-9b91-1a809551e27b tempest-TestMinimumBasicScenario-436212127 None] Lock "cinder-93ad7495-e6e8-4939-98b7-4bce4bbac50c-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:22:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d029d892-a6c4-48f2-9b91-1a809551e27b tempest-TestMinimumBasicScenario-436212127 None] Acquiring lock "cinder-quobyte-93ad7495-e6e8-4939-98b7-4bce4bbac50c" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:22:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d029d892-a6c4-48f2-9b91-1a809551e27b tempest-TestMinimumBasicScenario-436212127 None] Lock "cinder-quobyte-93ad7495-e6e8-4939-98b7-4bce4bbac50c" acquired by "delete_volume" :: waited 0.047s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:22:20 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97d10a2-0f92-43c6-bab2-042c75d58400]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:22:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d029d892-a6c4-48f2-9b91-1a809551e27b tempest-TestMinimumBasicScenario-436212127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-93ad7495-e6e8-4939-98b7-4bce4bbac50c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:20 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-93ad7495-e6e8-4939-98b7-4bce4bbac50c Jul 22 12:22:20 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:21 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d029d892-a6c4-48f2-9b91-1a809551e27b tempest-TestMinimumBasicScenario-436212127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-93ad7495-e6e8-4939-98b7-4bce4bbac50c" returned: 0 in 0.764s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d029d892-a6c4-48f2-9b91-1a809551e27b tempest-TestMinimumBasicScenario-436212127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-93ad7495-e6e8-4939-98b7-4bce4bbac50c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:21 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-93ad7495-e6e8-4939-98b7-4bce4bbac50c Jul 22 12:22:21 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:21 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d029d892-a6c4-48f2-9b91-1a809551e27b tempest-TestMinimumBasicScenario-436212127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-93ad7495-e6e8-4939-98b7-4bce4bbac50c" returned: 0 in 0.516s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:21 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d029d892-a6c4-48f2-9b91-1a809551e27b tempest-TestMinimumBasicScenario-436212127 None] Lock "cinder-quobyte-93ad7495-e6e8-4939-98b7-4bce4bbac50c" released by "delete_volume" :: held 1.394s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:22:21 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-d029d892-a6c4-48f2-9b91-1a809551e27b tempest-TestMinimumBasicScenario-436212127 None] Created reservations ['cf228a2a-8003-4607-950f-cbeba9de37e3', '3170638a-1980-4477-9a0e-a43cbfbaee5f', 'f173f3c6-aeb5-4145-967e-a99ea7a0aa10', 'd26e3b4b-83a5-42be-a1dd-9571d7379845'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:22:21 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-40518906-0710-42d9-84e3-34c422c16db4" returned: 0 in 7.347s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:21 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad558109-c866-4add-867f-d1885bc94168]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:22:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d029d892-a6c4-48f2-9b91-1a809551e27b tempest-TestMinimumBasicScenario-436212127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:22:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d029d892-a6c4-48f2-9b91-1a809551e27b tempest-TestMinimumBasicScenario-436212127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:22:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d029d892-a6c4-48f2-9b91-1a809551e27b tempest-TestMinimumBasicScenario-436212127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:22:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d029d892-a6c4-48f2-9b91-1a809551e27b tempest-TestMinimumBasicScenario-436212127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:22:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d029d892-a6c4-48f2-9b91-1a809551e27b tempest-TestMinimumBasicScenario-436212127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:22:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d029d892-a6c4-48f2-9b91-1a809551e27b tempest-TestMinimumBasicScenario-436212127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:22 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:22:22 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:22 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c Jul 22 12:22:22 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:22 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d029d892-a6c4-48f2-9b91-1a809551e27b tempest-TestMinimumBasicScenario-436212127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.674s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:22 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-d029d892-a6c4-48f2-9b91-1a809551e27b tempest-TestMinimumBasicScenario-436212127 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:22:22 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d029d892-a6c4-48f2-9b91-1a809551e27b tempest-TestMinimumBasicScenario-436212127 None] Deleted volume successfully. Jul 22 12:22:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d029d892-a6c4-48f2-9b91-1a809551e27b tempest-TestMinimumBasicScenario-436212127 None] Lock "cinder-93ad7495-e6e8-4939-98b7-4bce4bbac50c-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:22:23 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c" returned: 0 in 1.325s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Image conversion details: src /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c, size 1024.00 MB, duration 7.35 sec, destination /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-40518906-0710-42d9-84e3-34c422c16db4 {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:22:23 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Converted 1024.00 MB image at 139.34 MB/s Jul 22 12:22:23 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-40518906-0710-42d9-84e3-34c422c16db4 is being set with open permissions: ugo+rw Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-40518906-0710-42d9-84e3-34c422c16db4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:23 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-40518906-0710-42d9-84e3-34c422c16db4 Jul 22 12:22:23 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:23 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-40518906-0710-42d9-84e3-34c422c16db4" returned: 0 in 0.465s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Lock "cinder-quobyte-40518906-0710-42d9-84e3-34c422c16db4" released by "_copy_volume_from_snapshot" :: held 10.541s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Lock "cinder-quobyte-aefec434-aea7-4288-8ed5-88774cd0ff0b-40518906-0710-42d9-84e3-34c422c16db4" released by "_create_volume_from_snapshot" :: held 10.610s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.671s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.144s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Acquiring lock "cinder-quobyte-6bd83274-4991-43c4-a290-5b85cd474cbb-1e41be32-3d08-4459-8eae-887a9285a2c3" by "_create_volume_from_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Lock "cinder-quobyte-6bd83274-4991-43c4-a290-5b85cd474cbb-1e41be32-3d08-4459-8eae-887a9285a2c3" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Creating volume 1e41be32-3d08-4459-8eae-887a9285a2c3 from snapshot 6bd83274-4991-43c4-a290-5b85cd474cbb {{(pid=87568) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Acquiring lock "cinder-quobyte-1e41be32-3d08-4459-8eae-887a9285a2c3" by "_copy_volume_from_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f60101-0d64-4068-a0c4-2d46680a4040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40518906-0710-42d9-84e3-34c422c16db4', 'volume_size': 1, 'snapshot_id': 'aefec434-aea7-4288-8ed5-88774cd0ff0b'}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0124156-2bbf-4979-bfd0-65157881a69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Lock "cinder-quobyte-1e41be32-3d08-4459-8eae-887a9285a2c3" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] snapshot: 6bd83274-4991-43c4-a290-5b85cd474cbb, volume: 1e41be32-3d08-4459-8eae-887a9285a2c3, {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 12:22:23 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Volume volume-40518906-0710-42d9-84e3-34c422c16db4 (40518906-0710-42d9-84e3-34c422c16db4): created successfully Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0124156-2bbf-4979-bfd0-65157881a69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Flow 'volume_create_manager' (d77add37-ce1c-4c03-b2bb-03f4234a4c41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[759635e8-3ff1-43cc-8270-e70a6ff33d01]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:22:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:23 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-f00faebc-6ad9-48e8-af8b-6fa077c2e239 tempest-TestStampPattern-738882885 None] Created volume successfully. Jul 22 12:22:24 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb Jul 22 12:22:24 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:24 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb" returned: 0 in 0.494s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-139ee7cf-030d-4ddb-925a-db904050633d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:22:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] will copy from snapshot at /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 12:22:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Creating direct copy from snapshot {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 12:22:24 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d807fb7-73c1-4546-a7e6-4642a3a707bf]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:22:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:22:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:22:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:22:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:22:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:22:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:22:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:24 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:22:24 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:24 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d Jul 22 12:22:24 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:24 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.361s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:24 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:22:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:22:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread count: 28 {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:22:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread info: [<_MainThread(MainThread, started 137793405739136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:22:25 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d" returned: 0 in 0.701s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:25 devstack cinder-volume[87568]: DEBUG cinder.utils [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Path /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e41be32-3d08-4459-8eae-887a9285a2c3 not found in is_blk_device check {{(pid=87568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 12:22:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e41be32-3d08-4459-8eae-887a9285a2c3 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:25 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e41be32-3d08-4459-8eae-887a9285a2c3 Jul 22 12:22:25 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:31 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e41be32-3d08-4459-8eae-887a9285a2c3" returned: 0 in 6.010s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:31 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c5c2f5-9b30-4393-8493-1bb4a0b741c5]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:22:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:31 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d Jul 22 12:22:31 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:31 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d" returned: 0 in 0.644s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:31 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Image conversion details: src /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d, size 1024.00 MB, duration 6.01 sec, destination /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e41be32-3d08-4459-8eae-887a9285a2c3 {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:22:31 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Converted 1024.00 MB image at 170.35 MB/s Jul 22 12:22:31 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e41be32-3d08-4459-8eae-887a9285a2c3 is being set with open permissions: ugo+rw Jul 22 12:22:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e41be32-3d08-4459-8eae-887a9285a2c3 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:31 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e41be32-3d08-4459-8eae-887a9285a2c3 Jul 22 12:22:31 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:32 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e41be32-3d08-4459-8eae-887a9285a2c3" returned: 0 in 0.319s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Lock "cinder-quobyte-1e41be32-3d08-4459-8eae-887a9285a2c3" released by "_copy_volume_from_snapshot" :: held 8.316s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:22:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Lock "cinder-quobyte-6bd83274-4991-43c4-a290-5b85cd474cbb-1e41be32-3d08-4459-8eae-887a9285a2c3" released by "_create_volume_from_snapshot" :: held 8.374s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:22:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.411s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:22:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ccc6691-8022-48ad-96d1-70c90dfdd81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e41be32-3d08-4459-8eae-887a9285a2c3', 'volume_size': 1, 'snapshot_id': '6bd83274-4991-43c4-a290-5b85cd474cbb'}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed5be41-d88c-4d48-984d-942fbec234a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:32 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Volume volume-1e41be32-3d08-4459-8eae-887a9285a2c3 (1e41be32-3d08-4459-8eae-887a9285a2c3): created successfully Jul 22 12:22:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed5be41-d88c-4d48-984d-942fbec234a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:32 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Flow 'volume_create_manager' (0e2432d1-8d24-4154-b987-2388d5f6ca64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:22:32 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-05ce0b76-2ef4-43ac-b1c7-c8162964dccf tempest-SnapshotDependencyTests-2081341525 None] Created volume successfully. Jul 22 12:22:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9885f564-0dbb-4b8a-9821-0e690a60d9c3 tempest-SnapshotDependencyTests-2081341525 None] Acquiring lock "cinder-6bd83274-4991-43c4-a290-5b85cd474cbb-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:22:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9885f564-0dbb-4b8a-9821-0e690a60d9c3 tempest-SnapshotDependencyTests-2081341525 None] Lock "cinder-6bd83274-4991-43c4-a290-5b85cd474cbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:22:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9885f564-0dbb-4b8a-9821-0e690a60d9c3 tempest-SnapshotDependencyTests-2081341525 None] Acquiring lock "cinder-quobyte-139ee7cf-030d-4ddb-925a-db904050633d" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:22:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9885f564-0dbb-4b8a-9821-0e690a60d9c3 tempest-SnapshotDependencyTests-2081341525 None] Lock "cinder-quobyte-139ee7cf-030d-4ddb-925a-db904050633d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:22:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9885f564-0dbb-4b8a-9821-0e690a60d9c3 tempest-SnapshotDependencyTests-2081341525 None] Acquiring lock "cinder-quobyte-6bd83274-4991-43c4-a290-5b85cd474cbb" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:22:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9885f564-0dbb-4b8a-9821-0e690a60d9c3 tempest-SnapshotDependencyTests-2081341525 None] Lock "cinder-quobyte-6bd83274-4991-43c4-a290-5b85cd474cbb" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:22:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-9885f564-0dbb-4b8a-9821-0e690a60d9c3 tempest-SnapshotDependencyTests-2081341525 None] Deleting offline snapshot 6bd83274-4991-43c4-a290-5b85cd474cbb of volume 139ee7cf-030d-4ddb-925a-db904050633d {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:22:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-9885f564-0dbb-4b8a-9821-0e690a60d9c3 tempest-SnapshotDependencyTests-2081341525 None] snapshot_file for this snap is: volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:22:33 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33223de-e455-4be3-a1c0-c9ba3d938656]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:22:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9885f564-0dbb-4b8a-9821-0e690a60d9c3 tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:33 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb Jul 22 12:22:33 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:33 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9885f564-0dbb-4b8a-9821-0e690a60d9c3 tempest-SnapshotDependencyTests-2081341525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb" returned: 0 in 0.520s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-9885f564-0dbb-4b8a-9821-0e690a60d9c3 tempest-SnapshotDependencyTests-2081341525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-139ee7cf-030d-4ddb-925a-db904050633d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:22:33 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[2720bc90-da37-4545-b1a1-fc30ebec330e]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:22:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9885f564-0dbb-4b8a-9821-0e690a60d9c3 tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:33 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d Jul 22 12:22:33 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Flow 'volume_create_manager' (7b179163-bf19-405e-bfba-7e21054d5797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f88b87-a36d-4de6-a040-1d344be07739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:34 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f88b87-a36d-4de6-a040-1d344be07739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-205276747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52cdf900-7078-4d13-8eb8-a50beb34319c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c07ce8f7045489faa7c1f122e9f4372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:22:35Z,use_quota=True,user_id='63d42771b8d04e39b3fbe931e519b18d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e531a687-fe1d-4a2f-a9cd-78c860550567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e531a687-fe1d-4a2f-a9cd-78c860550567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be226dea-04a9-48a4-ba1e-dbf338eb8a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be226dea-04a9-48a4-ba1e-dbf338eb8a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52cdf900-7078-4d13-8eb8-a50beb34319c', 'volume_name': 'volume-52cdf900-7078-4d13-8eb8-a50beb34319c', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d093b74-0753-4685-926c-9e9fb2a51ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d093b74-0753-4685-926c-9e9fb2a51ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381a4c1f-4496-43a9-97c4-f0779076037f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:34 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Volume 52cdf900-7078-4d13-8eb8-a50beb34319c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52cdf900-7078-4d13-8eb8-a50beb34319c', 'volume_size': 1} Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-205276747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52cdf900-7078-4d13-8eb8-a50beb34319c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c07ce8f7045489faa7c1f122e9f4372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:22:35Z,use_quota=True,user_id='63d42771b8d04e39b3fbe931e519b18d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Creating volume 52cdf900-7078-4d13-8eb8-a50beb34319c {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:22:34 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-52cdf900-7078-4d13-8eb8-a50beb34319c 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9885f564-0dbb-4b8a-9821-0e690a60d9c3 tempest-SnapshotDependencyTests-2081341525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d" returned: 0 in 1.157s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9885f564-0dbb-4b8a-9821-0e690a60d9c3 tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:34 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-52cdf900-7078-4d13-8eb8-a50beb34319c 1073741824 Jul 22 12:22:34 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:34 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb Jul 22 12:22:34 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:35 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:22:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Flow 'volume_create_manager' (7c490943-3d4d-43d7-88f2-a15eaf022edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:22:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8931df6b-4303-47f1-89e8-e63581d77d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:35 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9885f564-0dbb-4b8a-9821-0e690a60d9c3 tempest-SnapshotDependencyTests-2081341525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb" returned: 0 in 0.735s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9885f564-0dbb-4b8a-9821-0e690a60d9c3 tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:35 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb Jul 22 12:22:35 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8931df6b-4303-47f1-89e8-e63581d77d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2084770397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35fb3a90-1cf8-47e0-a90e-54d0ffca56d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c07ce8f7045489faa7c1f122e9f4372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:22:35Z,use_quota=True,user_id='63d42771b8d04e39b3fbe931e519b18d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adaa9818-2adc-4fb7-b97c-1b01d301b66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adaa9818-2adc-4fb7-b97c-1b01d301b66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c724e79-f1e1-436e-b8cf-c383fecadbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c724e79-f1e1-436e-b8cf-c383fecadbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35fb3a90-1cf8-47e0-a90e-54d0ffca56d6', 'volume_name': 'volume-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:35 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64dd1305-a4a2-4bd3-b896-bf684a59d84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64dd1305-a4a2-4bd3-b896-bf684a59d84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (029752d0-fa06-499a-bfa7-cb0274cfae56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:35 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Volume 35fb3a90-1cf8-47e0-a90e-54d0ffca56d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6', 'volume_size': 1} Jul 22 12:22:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:22:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-52cdf900-7078-4d13-8eb8-a50beb34319c 1073741824" returned: 0 in 0.971s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-52cdf900-7078-4d13-8eb8-a50beb34319c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:35 devstack sudo[101677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-52cdf900-7078-4d13-8eb8-a50beb34319c Jul 22 12:22:35 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:36 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9885f564-0dbb-4b8a-9821-0e690a60d9c3 tempest-SnapshotDependencyTests-2081341525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d.6bd83274-4991-43c4-a290-5b85cd474cbb" returned: 0 in 0.399s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9885f564-0dbb-4b8a-9821-0e690a60d9c3 tempest-SnapshotDependencyTests-2081341525 None] Lock "cinder-quobyte-6bd83274-4991-43c4-a290-5b85cd474cbb" released by "_delete_snapshot" :: held 3.000s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:22:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9885f564-0dbb-4b8a-9821-0e690a60d9c3 tempest-SnapshotDependencyTests-2081341525 None] Lock "cinder-quobyte-139ee7cf-030d-4ddb-925a-db904050633d" released by "delete_snapshot" :: held 3.042s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:22:36 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-9885f564-0dbb-4b8a-9821-0e690a60d9c3 tempest-SnapshotDependencyTests-2081341525 None] Created reservations ['2b5e5e88-4705-4ada-934e-9af964479cba', '356a8547-274c-48ad-a89a-8e8f60fa7178', '34ffc0a0-a5cd-45c0-8964-35c9b5b57a8f', 'e1eb6d55-0b1a-42f5-8ff6-b8bf06cc9416'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:22:36 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-52cdf900-7078-4d13-8eb8-a50beb34319c" returned: 0 in 0.549s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:22:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:22:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.625s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:22:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2084770397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35fb3a90-1cf8-47e0-a90e-54d0ffca56d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c07ce8f7045489faa7c1f122e9f4372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:22:35Z,use_quota=True,user_id='63d42771b8d04e39b3fbe931e519b18d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:22:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Creating volume 35fb3a90-1cf8-47e0-a90e-54d0ffca56d6 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:22:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:22:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:22:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:22:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:22:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:22:36 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:22:36 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:22:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381a4c1f-4496-43a9-97c4-f0779076037f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52cdf900-7078-4d13-8eb8-a50beb34319c', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109245cf-42c3-4307-8b87-86e1f65f86e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:36 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6 1073741824 Jul 22 12:22:36 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:36 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Volume volume-52cdf900-7078-4d13-8eb8-a50beb34319c (52cdf900-7078-4d13-8eb8-a50beb34319c): created successfully Jul 22 12:22:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109245cf-42c3-4307-8b87-86e1f65f86e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Flow 'volume_create_manager' (7b179163-bf19-405e-bfba-7e21054d5797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:22:36 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-9885f564-0dbb-4b8a-9821-0e690a60d9c3 tempest-SnapshotDependencyTests-2081341525 None] Delete snapshot completed successfully. Jul 22 12:22:36 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-1feca672-7fb9-4a0a-a443-0d8401c4475d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Created volume successfully. Jul 22 12:22:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9885f564-0dbb-4b8a-9821-0e690a60d9c3 tempest-SnapshotDependencyTests-2081341525 None] Lock "cinder-6bd83274-4991-43c4-a290-5b85cd474cbb-delete_snapshot" released by "delete_snapshot" :: held 3.601s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:22:37 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6 1073741824" returned: 0 in 0.919s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:37 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6 Jul 22 12:22:37 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e5971aa7-064a-420f-90cf-65d99af91cfc tempest-SnapshotDependencyTests-2081341525 None] Acquiring lock "cinder-139ee7cf-030d-4ddb-925a-db904050633d-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:22:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e5971aa7-064a-420f-90cf-65d99af91cfc tempest-SnapshotDependencyTests-2081341525 None] Lock "cinder-139ee7cf-030d-4ddb-925a-db904050633d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:22:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e5971aa7-064a-420f-90cf-65d99af91cfc tempest-SnapshotDependencyTests-2081341525 None] Acquiring lock "cinder-quobyte-139ee7cf-030d-4ddb-925a-db904050633d" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:22:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e5971aa7-064a-420f-90cf-65d99af91cfc tempest-SnapshotDependencyTests-2081341525 None] Lock "cinder-quobyte-139ee7cf-030d-4ddb-925a-db904050633d" acquired by "delete_volume" :: waited 0.032s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:22:37 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8d1454-9d46-4387-ba9d-79f8909ad073]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:22:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e5971aa7-064a-420f-90cf-65d99af91cfc tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:37 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d Jul 22 12:22:37 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:38 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6" returned: 0 in 0.562s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:22:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:22:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (029752d0-fa06-499a-bfa7-cb0274cfae56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6105c5f0-8694-4344-8194-d9c0c471881a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:22:38 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Volume volume-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6 (35fb3a90-1cf8-47e0-a90e-54d0ffca56d6): created successfully Jul 22 12:22:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6105c5f0-8694-4344-8194-d9c0c471881a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:22:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Flow 'volume_create_manager' (7c490943-3d4d-43d7-88f2-a15eaf022edf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:22:38 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-13fc0be8-4ad3-4e6a-9af2-abcd8394d240 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Created volume successfully. Jul 22 12:22:38 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e5971aa7-064a-420f-90cf-65d99af91cfc tempest-SnapshotDependencyTests-2081341525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d" returned: 0 in 0.712s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e5971aa7-064a-420f-90cf-65d99af91cfc tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:38 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d Jul 22 12:22:38 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:38 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e5971aa7-064a-420f-90cf-65d99af91cfc tempest-SnapshotDependencyTests-2081341525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-139ee7cf-030d-4ddb-925a-db904050633d" returned: 0 in 0.328s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:38 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e5971aa7-064a-420f-90cf-65d99af91cfc tempest-SnapshotDependencyTests-2081341525 None] Lock "cinder-quobyte-139ee7cf-030d-4ddb-925a-db904050633d" released by "delete_volume" :: held 1.166s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:22:38 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-e5971aa7-064a-420f-90cf-65d99af91cfc tempest-SnapshotDependencyTests-2081341525 None] Created reservations ['8ec34659-dd5f-4b79-ab9e-d969033a219a', '04fda148-617d-47c2-a5a4-4ba751246fc9', 'c60042e8-1b56-4c98-b260-334cb757d669', 'e1966762-5a3d-4078-adc9-6a9d861b0059'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:22:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e5971aa7-064a-420f-90cf-65d99af91cfc tempest-SnapshotDependencyTests-2081341525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:22:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e5971aa7-064a-420f-90cf-65d99af91cfc tempest-SnapshotDependencyTests-2081341525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:22:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e5971aa7-064a-420f-90cf-65d99af91cfc tempest-SnapshotDependencyTests-2081341525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:22:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e5971aa7-064a-420f-90cf-65d99af91cfc tempest-SnapshotDependencyTests-2081341525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:22:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e5971aa7-064a-420f-90cf-65d99af91cfc tempest-SnapshotDependencyTests-2081341525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:22:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e5971aa7-064a-420f-90cf-65d99af91cfc tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:39 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:22:39 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:39 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e5971aa7-064a-420f-90cf-65d99af91cfc tempest-SnapshotDependencyTests-2081341525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.429s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:39 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-e5971aa7-064a-420f-90cf-65d99af91cfc tempest-SnapshotDependencyTests-2081341525 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:22:39 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e5971aa7-064a-420f-90cf-65d99af91cfc tempest-SnapshotDependencyTests-2081341525 None] Deleted volume successfully. Jul 22 12:22:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e5971aa7-064a-420f-90cf-65d99af91cfc tempest-SnapshotDependencyTests-2081341525 None] Lock "cinder-139ee7cf-030d-4ddb-925a-db904050633d-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:22:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d96e50f3-4e97-4c29-a093-3e5072df25c6 tempest-SnapshotDependencyTests-2081341525 None] Acquiring lock "cinder-1e41be32-3d08-4459-8eae-887a9285a2c3-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:22:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d96e50f3-4e97-4c29-a093-3e5072df25c6 tempest-SnapshotDependencyTests-2081341525 None] Lock "cinder-1e41be32-3d08-4459-8eae-887a9285a2c3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:22:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d96e50f3-4e97-4c29-a093-3e5072df25c6 tempest-SnapshotDependencyTests-2081341525 None] Acquiring lock "cinder-quobyte-1e41be32-3d08-4459-8eae-887a9285a2c3" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:22:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d96e50f3-4e97-4c29-a093-3e5072df25c6 tempest-SnapshotDependencyTests-2081341525 None] Lock "cinder-quobyte-1e41be32-3d08-4459-8eae-887a9285a2c3" acquired by "delete_volume" :: waited 0.031s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:22:40 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2e48b3-18dc-49ce-ab9b-2b355bb64b2e]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:22:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d96e50f3-4e97-4c29-a093-3e5072df25c6 tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e41be32-3d08-4459-8eae-887a9285a2c3 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:40 devstack sudo[101706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e41be32-3d08-4459-8eae-887a9285a2c3 Jul 22 12:22:40 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:40 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d96e50f3-4e97-4c29-a093-3e5072df25c6 tempest-SnapshotDependencyTests-2081341525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e41be32-3d08-4459-8eae-887a9285a2c3" returned: 0 in 0.538s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d96e50f3-4e97-4c29-a093-3e5072df25c6 tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e41be32-3d08-4459-8eae-887a9285a2c3 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:40 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e41be32-3d08-4459-8eae-887a9285a2c3 Jul 22 12:22:40 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:41 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d96e50f3-4e97-4c29-a093-3e5072df25c6 tempest-SnapshotDependencyTests-2081341525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e41be32-3d08-4459-8eae-887a9285a2c3" returned: 0 in 0.388s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d96e50f3-4e97-4c29-a093-3e5072df25c6 tempest-SnapshotDependencyTests-2081341525 None] Lock "cinder-quobyte-1e41be32-3d08-4459-8eae-887a9285a2c3" released by "delete_volume" :: held 1.000s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:22:41 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-d96e50f3-4e97-4c29-a093-3e5072df25c6 tempest-SnapshotDependencyTests-2081341525 None] Created reservations ['b297cad3-a385-4128-bd37-2b0000a0f5e5', '8d6b6b91-774e-4a7c-a90f-c933926ae144', 'dac3da8d-233a-47df-b944-767e6f6e8b8d', '56ca534f-7804-471b-8840-d30694e12514'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:22:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d96e50f3-4e97-4c29-a093-3e5072df25c6 tempest-SnapshotDependencyTests-2081341525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:22:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d96e50f3-4e97-4c29-a093-3e5072df25c6 tempest-SnapshotDependencyTests-2081341525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:22:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d96e50f3-4e97-4c29-a093-3e5072df25c6 tempest-SnapshotDependencyTests-2081341525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:22:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d96e50f3-4e97-4c29-a093-3e5072df25c6 tempest-SnapshotDependencyTests-2081341525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:22:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d96e50f3-4e97-4c29-a093-3e5072df25c6 tempest-SnapshotDependencyTests-2081341525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:22:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d96e50f3-4e97-4c29-a093-3e5072df25c6 tempest-SnapshotDependencyTests-2081341525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:22:41 devstack sudo[101716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:22:41 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:22:41 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root Jul 22 12:22:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d96e50f3-4e97-4c29-a093-3e5072df25c6 tempest-SnapshotDependencyTests-2081341525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.311s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:22:41 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-d96e50f3-4e97-4c29-a093-3e5072df25c6 tempest-SnapshotDependencyTests-2081341525 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:22:41 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d96e50f3-4e97-4c29-a093-3e5072df25c6 tempest-SnapshotDependencyTests-2081341525 None] Deleted volume successfully. Jul 22 12:22:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d96e50f3-4e97-4c29-a093-3e5072df25c6 tempest-SnapshotDependencyTests-2081341525 None] Lock "cinder-1e41be32-3d08-4459-8eae-887a9285a2c3-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:22:51 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=46,cinder:UPDATE=52,cinder:DELETE=8,cinder:INSERT=9 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:22:51 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=48,cinder:UPDATE=42,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:23:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-403dfd7d-0b5b-4e65-9df7-f1182ad8e055 req-843e3c92-9e7f-4a0e-ab45-7d77d820cd91 tempest-TestStampPattern-738882885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-403dfd7d-0b5b-4e65-9df7-f1182ad8e055 req-843e3c92-9e7f-4a0e-ab45-7d77d820cd91 tempest-TestStampPattern-738882885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:05 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3fddc6-3f21-4e61-8cfb-6bcb8636de04]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:23:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-403dfd7d-0b5b-4e65-9df7-f1182ad8e055 req-843e3c92-9e7f-4a0e-ab45-7d77d820cd91 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-40518906-0710-42d9-84e3-34c422c16db4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:05 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-40518906-0710-42d9-84e3-34c422c16db4 Jul 22 12:23:05 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:05 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [req-403dfd7d-0b5b-4e65-9df7-f1182ad8e055 req-843e3c92-9e7f-4a0e-ab45-7d77d820cd91 tempest-TestStampPattern-738882885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-40518906-0710-42d9-84e3-34c422c16db4" returned: 0 in 0.533s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-403dfd7d-0b5b-4e65-9df7-f1182ad8e055 req-843e3c92-9e7f-4a0e-ab45-7d77d820cd91 tempest-TestStampPattern-738882885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.567s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:05 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-403dfd7d-0b5b-4e65-9df7-f1182ad8e055 req-843e3c92-9e7f-4a0e-ab45-7d77d820cd91 tempest-TestStampPattern-738882885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29', 'name': 'volume-40518906-0710-42d9-84e3-34c422c16db4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9afb215-e599-4cec-866d-9a75c735a463', 'enforce_multipath': True} {{(pid=87568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 12:23:05 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-403dfd7d-0b5b-4e65-9df7-f1182ad8e055 req-843e3c92-9e7f-4a0e-ab45-7d77d820cd91 tempest-TestStampPattern-738882885 None] attachment_update completed successfully. Jul 22 12:23:08 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-00d0b0e6-e1c1-4bd1-97e5-4901c1cab3f0 req-4dde6b98-4ed0-4535-88ec-742f9ac07000 tempest-TestStampPattern-738882885 None] Terminate volume connection completed successfully. Jul 22 12:23:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-00d0b0e6-e1c1-4bd1-97e5-4901c1cab3f0 req-4dde6b98-4ed0-4535-88ec-742f9ac07000 tempest-TestStampPattern-738882885 None] Deleting attachment e9afb215-e599-4cec-866d-9a75c735a463. {{(pid=87568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 12:23:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3de47408-5b59-4d72-b7d1-0589e562d624 tempest-TestStampPattern-738882885 None] Acquiring lock "cinder-40518906-0710-42d9-84e3-34c422c16db4-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:23:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3de47408-5b59-4d72-b7d1-0589e562d624 tempest-TestStampPattern-738882885 None] Lock "cinder-40518906-0710-42d9-84e3-34c422c16db4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:23:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3de47408-5b59-4d72-b7d1-0589e562d624 tempest-TestStampPattern-738882885 None] Acquiring lock "cinder-quobyte-40518906-0710-42d9-84e3-34c422c16db4" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:23:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3de47408-5b59-4d72-b7d1-0589e562d624 tempest-TestStampPattern-738882885 None] Lock "cinder-quobyte-40518906-0710-42d9-84e3-34c422c16db4" acquired by "delete_volume" :: waited 0.030s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:23:13 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7afbf0-2525-4f35-ac9a-4de6eac559c6]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:23:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3de47408-5b59-4d72-b7d1-0589e562d624 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-40518906-0710-42d9-84e3-34c422c16db4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:13 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-40518906-0710-42d9-84e3-34c422c16db4 Jul 22 12:23:13 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:13 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3de47408-5b59-4d72-b7d1-0589e562d624 tempest-TestStampPattern-738882885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-40518906-0710-42d9-84e3-34c422c16db4" returned: 0 in 0.404s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3de47408-5b59-4d72-b7d1-0589e562d624 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-40518906-0710-42d9-84e3-34c422c16db4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:13 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-40518906-0710-42d9-84e3-34c422c16db4 Jul 22 12:23:13 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:14 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3de47408-5b59-4d72-b7d1-0589e562d624 tempest-TestStampPattern-738882885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-40518906-0710-42d9-84e3-34c422c16db4" returned: 0 in 0.279s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:14 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3de47408-5b59-4d72-b7d1-0589e562d624 tempest-TestStampPattern-738882885 None] Lock "cinder-quobyte-40518906-0710-42d9-84e3-34c422c16db4" released by "delete_volume" :: held 0.727s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:23:14 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-3de47408-5b59-4d72-b7d1-0589e562d624 tempest-TestStampPattern-738882885 None] Created reservations ['735ec938-3f9c-4df1-bfda-18e96e657c4e', '0d6d3fd1-7ba1-4f30-a068-ea7f54b7e748', '65763236-430d-4f38-a843-b5c2a836a8f2', 'ee9776c5-9531-49db-827b-ebc6386f9ad2'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:23:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3de47408-5b59-4d72-b7d1-0589e562d624 tempest-TestStampPattern-738882885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3de47408-5b59-4d72-b7d1-0589e562d624 tempest-TestStampPattern-738882885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3de47408-5b59-4d72-b7d1-0589e562d624 tempest-TestStampPattern-738882885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:23:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3de47408-5b59-4d72-b7d1-0589e562d624 tempest-TestStampPattern-738882885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:23:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3de47408-5b59-4d72-b7d1-0589e562d624 tempest-TestStampPattern-738882885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3de47408-5b59-4d72-b7d1-0589e562d624 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:14 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:23:14 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:14 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3de47408-5b59-4d72-b7d1-0589e562d624 tempest-TestStampPattern-738882885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.301s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:14 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-3de47408-5b59-4d72-b7d1-0589e562d624 tempest-TestStampPattern-738882885 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:23:14 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-3de47408-5b59-4d72-b7d1-0589e562d624 tempest-TestStampPattern-738882885 None] Deleted volume successfully. Jul 22 12:23:14 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3de47408-5b59-4d72-b7d1-0589e562d624 tempest-TestStampPattern-738882885 None] Lock "cinder-40518906-0710-42d9-84e3-34c422c16db4-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:23:14 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-71120fab-a7b4-453e-adff-718fab986043 tempest-TestStampPattern-738882885 None] Acquiring lock "cinder-aefec434-aea7-4288-8ed5-88774cd0ff0b-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:23:14 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-71120fab-a7b4-453e-adff-718fab986043 tempest-TestStampPattern-738882885 None] Lock "cinder-aefec434-aea7-4288-8ed5-88774cd0ff0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:23:14 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-71120fab-a7b4-453e-adff-718fab986043 tempest-TestStampPattern-738882885 None] Acquiring lock "cinder-quobyte-6a62544e-f9d1-47b7-894d-b05d5f4fa86c" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:23:14 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-71120fab-a7b4-453e-adff-718fab986043 tempest-TestStampPattern-738882885 None] Lock "cinder-quobyte-6a62544e-f9d1-47b7-894d-b05d5f4fa86c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:23:14 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-71120fab-a7b4-453e-adff-718fab986043 tempest-TestStampPattern-738882885 None] Acquiring lock "cinder-quobyte-aefec434-aea7-4288-8ed5-88774cd0ff0b" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:23:14 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-71120fab-a7b4-453e-adff-718fab986043 tempest-TestStampPattern-738882885 None] Lock "cinder-quobyte-aefec434-aea7-4288-8ed5-88774cd0ff0b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:23:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-71120fab-a7b4-453e-adff-718fab986043 tempest-TestStampPattern-738882885 None] Deleting offline snapshot aefec434-aea7-4288-8ed5-88774cd0ff0b of volume 6a62544e-f9d1-47b7-894d-b05d5f4fa86c {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:23:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-71120fab-a7b4-453e-adff-718fab986043 tempest-TestStampPattern-738882885 None] snapshot_file for this snap is: volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:23:14 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcfdac3-cad6-49cb-915e-e901474cabde]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:23:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-71120fab-a7b4-453e-adff-718fab986043 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:15 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b Jul 22 12:23:15 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:15 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-71120fab-a7b4-453e-adff-718fab986043 tempest-TestStampPattern-738882885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b" returned: 0 in 0.377s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:15 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-71120fab-a7b4-453e-adff-718fab986043 tempest-TestStampPattern-738882885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:23:15 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[7227b405-d636-4ca5-bf6a-f07593e7a9e2]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:23:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-71120fab-a7b4-453e-adff-718fab986043 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:15 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c Jul 22 12:23:15 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:15 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-71120fab-a7b4-453e-adff-718fab986043 tempest-TestStampPattern-738882885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c" returned: 0 in 0.380s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-71120fab-a7b4-453e-adff-718fab986043 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:15 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b Jul 22 12:23:15 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:16 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-71120fab-a7b4-453e-adff-718fab986043 tempest-TestStampPattern-738882885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b" returned: 0 in 0.380s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-71120fab-a7b4-453e-adff-718fab986043 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:16 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b Jul 22 12:23:16 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:16 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-71120fab-a7b4-453e-adff-718fab986043 tempest-TestStampPattern-738882885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c.aefec434-aea7-4288-8ed5-88774cd0ff0b" returned: 0 in 0.260s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-71120fab-a7b4-453e-adff-718fab986043 tempest-TestStampPattern-738882885 None] Lock "cinder-quobyte-aefec434-aea7-4288-8ed5-88774cd0ff0b" released by "_delete_snapshot" :: held 1.507s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:23:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-71120fab-a7b4-453e-adff-718fab986043 tempest-TestStampPattern-738882885 None] Lock "cinder-quobyte-6a62544e-f9d1-47b7-894d-b05d5f4fa86c" released by "delete_snapshot" :: held 1.534s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:23:16 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-71120fab-a7b4-453e-adff-718fab986043 tempest-TestStampPattern-738882885 None] Created reservations ['c20f56d8-306e-422a-9b79-684718fa5f7b', '1c2a6d0e-7c45-4772-80cb-39a041928bfc', '34fe7457-6984-49f0-b336-c1b13cb21772', '7ebfc86f-f118-47ad-b63f-0fb4bdcfeb67'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:23:16 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-71120fab-a7b4-453e-adff-718fab986043 tempest-TestStampPattern-738882885 None] Delete snapshot completed successfully. Jul 22 12:23:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-71120fab-a7b4-453e-adff-718fab986043 tempest-TestStampPattern-738882885 None] Lock "cinder-aefec434-aea7-4288-8ed5-88774cd0ff0b-delete_snapshot" released by "delete_snapshot" :: held 1.687s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:23:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-d8065997-ec85-426d-b72a-fc315769d607 req-3901cdd1-436b-4ed1-8201-feefdc35c5d1 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-d8065997-ec85-426d-b72a-fc315769d607 req-3901cdd1-436b-4ed1-8201-feefdc35c5d1 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-d8065997-ec85-426d-b72a-fc315769d607 req-3901cdd1-436b-4ed1-8201-feefdc35c5d1 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-d8065997-ec85-426d-b72a-fc315769d607 req-3901cdd1-436b-4ed1-8201-feefdc35c5d1 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29', 'name': 'volume-52cdf900-7078-4d13-8eb8-a50beb34319c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '456fee57-391d-42af-bae1-efe55f16ff8a', 'enforce_multipath': True} {{(pid=87568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 12:23:19 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-d8065997-ec85-426d-b72a-fc315769d607 req-3901cdd1-436b-4ed1-8201-feefdc35c5d1 tempest-TestServerVolumeAttachmentScenario-1036386495 None] attachment_update completed successfully. Jul 22 12:23:21 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6176c2b4-0485-4d07-aff9-d78badbffad1 tempest-TestStampPattern-738882885 None] Acquiring lock "cinder-6a62544e-f9d1-47b7-894d-b05d5f4fa86c-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:23:21 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6176c2b4-0485-4d07-aff9-d78badbffad1 tempest-TestStampPattern-738882885 None] Lock "cinder-6a62544e-f9d1-47b7-894d-b05d5f4fa86c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:23:21 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6176c2b4-0485-4d07-aff9-d78badbffad1 tempest-TestStampPattern-738882885 None] Acquiring lock "cinder-quobyte-6a62544e-f9d1-47b7-894d-b05d5f4fa86c" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:23:21 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6176c2b4-0485-4d07-aff9-d78badbffad1 tempest-TestStampPattern-738882885 None] Lock "cinder-quobyte-6a62544e-f9d1-47b7-894d-b05d5f4fa86c" acquired by "delete_volume" :: waited 0.026s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:23:21 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4680e7-3ebc-435a-9994-8d1110fb925b]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:23:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6176c2b4-0485-4d07-aff9-d78badbffad1 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:22 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c Jul 22 12:23:22 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:22 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6176c2b4-0485-4d07-aff9-d78badbffad1 tempest-TestStampPattern-738882885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c" returned: 0 in 0.486s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6176c2b4-0485-4d07-aff9-d78badbffad1 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:22 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c Jul 22 12:23:22 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:22 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6176c2b4-0485-4d07-aff9-d78badbffad1 tempest-TestStampPattern-738882885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6a62544e-f9d1-47b7-894d-b05d5f4fa86c" returned: 0 in 0.300s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6176c2b4-0485-4d07-aff9-d78badbffad1 tempest-TestStampPattern-738882885 None] Lock "cinder-quobyte-6a62544e-f9d1-47b7-894d-b05d5f4fa86c" released by "delete_volume" :: held 0.870s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:23:22 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-6176c2b4-0485-4d07-aff9-d78badbffad1 tempest-TestStampPattern-738882885 None] Created reservations ['d610626c-d813-4d1c-8dce-de23d9dc1fda', '17e31403-4e76-44b9-b9c8-e85a54633ab7', '9da87bfd-229a-4a49-a44f-f7c34add8dcf', 'aa64ef27-4b5e-4268-9040-dc75a2b46471'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:23:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6176c2b4-0485-4d07-aff9-d78badbffad1 tempest-TestStampPattern-738882885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6176c2b4-0485-4d07-aff9-d78badbffad1 tempest-TestStampPattern-738882885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6176c2b4-0485-4d07-aff9-d78badbffad1 tempest-TestStampPattern-738882885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:23:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6176c2b4-0485-4d07-aff9-d78badbffad1 tempest-TestStampPattern-738882885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:23:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6176c2b4-0485-4d07-aff9-d78badbffad1 tempest-TestStampPattern-738882885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6176c2b4-0485-4d07-aff9-d78badbffad1 tempest-TestStampPattern-738882885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:22 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:23:22 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:23 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6176c2b4-0485-4d07-aff9-d78badbffad1 tempest-TestStampPattern-738882885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.369s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:23 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-6176c2b4-0485-4d07-aff9-d78badbffad1 tempest-TestStampPattern-738882885 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:23:23 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-6176c2b4-0485-4d07-aff9-d78badbffad1 tempest-TestStampPattern-738882885 None] Deleted volume successfully. Jul 22 12:23:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6176c2b4-0485-4d07-aff9-d78badbffad1 tempest-TestStampPattern-738882885 None] Lock "cinder-6a62544e-f9d1-47b7-894d-b05d5f4fa86c-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:23:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:23:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:23:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:23:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:24 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:23:24 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:24 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.294s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:24 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:23:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:23:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread count: 28 {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:23:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread info: [<_MainThread(MainThread, started 137793405739136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:23:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-4064f9cd-8531-4455-88ba-3e7fd2dc3d8b req-1a69da93-4d9a-48b2-8225-508c4e2cf1f8 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-4064f9cd-8531-4455-88ba-3e7fd2dc3d8b req-1a69da93-4d9a-48b2-8225-508c4e2cf1f8 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-4064f9cd-8531-4455-88ba-3e7fd2dc3d8b req-1a69da93-4d9a-48b2-8225-508c4e2cf1f8 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-4064f9cd-8531-4455-88ba-3e7fd2dc3d8b req-1a69da93-4d9a-48b2-8225-508c4e2cf1f8 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29', 'name': 'volume-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f980113-29fc-464b-9126-21a88d0ce924', 'enforce_multipath': True} {{(pid=87568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 12:23:25 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-4064f9cd-8531-4455-88ba-3e7fd2dc3d8b req-1a69da93-4d9a-48b2-8225-508c4e2cf1f8 tempest-TestServerVolumeAttachmentScenario-1036386495 None] attachment_update completed successfully. Jul 22 12:23:27 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-5dbe284c-77aa-4fe8-b871-43410a766905 req-4a17ba4d-e250-4d0c-a512-ad23fb7e545b tempest-TestServerVolumeAttachmentScenario-1036386495 None] Terminate volume connection completed successfully. Jul 22 12:23:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-5dbe284c-77aa-4fe8-b871-43410a766905 req-4a17ba4d-e250-4d0c-a512-ad23fb7e545b tempest-TestServerVolumeAttachmentScenario-1036386495 None] Deleting attachment 4f980113-29fc-464b-9126-21a88d0ce924. {{(pid=87568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 12:23:29 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-ea26f9ec-ad6c-44ac-a25a-69d3643b1457 req-df5683e1-fa98-4ad3-b084-9d5ba2438c9d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Terminate volume connection completed successfully. Jul 22 12:23:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-ea26f9ec-ad6c-44ac-a25a-69d3643b1457 req-df5683e1-fa98-4ad3-b084-9d5ba2438c9d tempest-TestServerVolumeAttachmentScenario-1036386495 None] Deleting attachment 456fee57-391d-42af-bae1-efe55f16ff8a. {{(pid=87568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 12:23:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e27f87d4-dbfe-416d-87e9-4db2a52261ab tempest-TestServerVolumeAttachmentScenario-1036386495 None] Acquiring lock "cinder-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:23:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e27f87d4-dbfe-416d-87e9-4db2a52261ab tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "cinder-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:23:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e27f87d4-dbfe-416d-87e9-4db2a52261ab tempest-TestServerVolumeAttachmentScenario-1036386495 None] Acquiring lock "cinder-quobyte-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:23:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e27f87d4-dbfe-416d-87e9-4db2a52261ab tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "cinder-quobyte-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6" acquired by "delete_volume" :: waited 0.029s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:23:36 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0eb86e2-6e6c-4343-a893-7c770c8dcf2c]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:23:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e27f87d4-dbfe-416d-87e9-4db2a52261ab tempest-TestServerVolumeAttachmentScenario-1036386495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:36 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6 Jul 22 12:23:36 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:36 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e27f87d4-dbfe-416d-87e9-4db2a52261ab tempest-TestServerVolumeAttachmentScenario-1036386495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6" returned: 0 in 0.419s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e27f87d4-dbfe-416d-87e9-4db2a52261ab tempest-TestServerVolumeAttachmentScenario-1036386495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:36 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6 Jul 22 12:23:36 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:37 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e27f87d4-dbfe-416d-87e9-4db2a52261ab tempest-TestServerVolumeAttachmentScenario-1036386495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6" returned: 0 in 0.298s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e27f87d4-dbfe-416d-87e9-4db2a52261ab tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "cinder-quobyte-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6" released by "delete_volume" :: held 0.769s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:23:37 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-e27f87d4-dbfe-416d-87e9-4db2a52261ab tempest-TestServerVolumeAttachmentScenario-1036386495 None] Created reservations ['77e913c3-955b-42c5-90db-573f51d4e4dd', 'e0ead34a-ee35-42ff-8c1d-b42aa0567263', '4df9c3fc-7a14-486f-a1f7-a3f6922a1463', '30523da4-260e-4f37-9ddc-5979b0eae519'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:23:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e27f87d4-dbfe-416d-87e9-4db2a52261ab tempest-TestServerVolumeAttachmentScenario-1036386495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e27f87d4-dbfe-416d-87e9-4db2a52261ab tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e27f87d4-dbfe-416d-87e9-4db2a52261ab tempest-TestServerVolumeAttachmentScenario-1036386495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:23:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e27f87d4-dbfe-416d-87e9-4db2a52261ab tempest-TestServerVolumeAttachmentScenario-1036386495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:23:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e27f87d4-dbfe-416d-87e9-4db2a52261ab tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e27f87d4-dbfe-416d-87e9-4db2a52261ab tempest-TestServerVolumeAttachmentScenario-1036386495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:37 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:23:37 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9cb65653-e103-4087-be97-f763a3d1ef29 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Acquiring lock "cinder-52cdf900-7078-4d13-8eb8-a50beb34319c-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:23:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9cb65653-e103-4087-be97-f763a3d1ef29 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "cinder-52cdf900-7078-4d13-8eb8-a50beb34319c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:23:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9cb65653-e103-4087-be97-f763a3d1ef29 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Acquiring lock "cinder-quobyte-52cdf900-7078-4d13-8eb8-a50beb34319c" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:23:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9cb65653-e103-4087-be97-f763a3d1ef29 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "cinder-quobyte-52cdf900-7078-4d13-8eb8-a50beb34319c" acquired by "delete_volume" :: waited 0.022s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:23:37 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[426dc86a-5e41-410c-ab97-e604365093a5]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:23:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9cb65653-e103-4087-be97-f763a3d1ef29 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-52cdf900-7078-4d13-8eb8-a50beb34319c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:37 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e27f87d4-dbfe-416d-87e9-4db2a52261ab tempest-TestServerVolumeAttachmentScenario-1036386495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.400s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:37 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-e27f87d4-dbfe-416d-87e9-4db2a52261ab tempest-TestServerVolumeAttachmentScenario-1036386495 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:23:37 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e27f87d4-dbfe-416d-87e9-4db2a52261ab tempest-TestServerVolumeAttachmentScenario-1036386495 None] Deleted volume successfully. Jul 22 12:23:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e27f87d4-dbfe-416d-87e9-4db2a52261ab tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "cinder-35fb3a90-1cf8-47e0-a90e-54d0ffca56d6-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:23:37 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-52cdf900-7078-4d13-8eb8-a50beb34319c Jul 22 12:23:37 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:38 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9cb65653-e103-4087-be97-f763a3d1ef29 tempest-TestServerVolumeAttachmentScenario-1036386495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-52cdf900-7078-4d13-8eb8-a50beb34319c" returned: 0 in 0.445s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9cb65653-e103-4087-be97-f763a3d1ef29 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-52cdf900-7078-4d13-8eb8-a50beb34319c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:38 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-52cdf900-7078-4d13-8eb8-a50beb34319c Jul 22 12:23:38 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:38 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9cb65653-e103-4087-be97-f763a3d1ef29 tempest-TestServerVolumeAttachmentScenario-1036386495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-52cdf900-7078-4d13-8eb8-a50beb34319c" returned: 0 in 0.289s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:38 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9cb65653-e103-4087-be97-f763a3d1ef29 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "cinder-quobyte-52cdf900-7078-4d13-8eb8-a50beb34319c" released by "delete_volume" :: held 0.787s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:23:38 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-9cb65653-e103-4087-be97-f763a3d1ef29 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Created reservations ['85524190-914c-4934-94d2-b6fa88e3a17c', 'fefaef33-70e3-4b4e-ad78-3c16cdc1e3c7', '1e87116c-d951-415b-98ef-2b35190607e9', '860678f1-78af-4a22-9fc7-c875673ba956'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:23:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9cb65653-e103-4087-be97-f763a3d1ef29 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9cb65653-e103-4087-be97-f763a3d1ef29 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9cb65653-e103-4087-be97-f763a3d1ef29 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:23:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9cb65653-e103-4087-be97-f763a3d1ef29 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:23:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9cb65653-e103-4087-be97-f763a3d1ef29 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9cb65653-e103-4087-be97-f763a3d1ef29 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:38 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:23:38 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:38 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9cb65653-e103-4087-be97-f763a3d1ef29 tempest-TestServerVolumeAttachmentScenario-1036386495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.363s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:38 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-9cb65653-e103-4087-be97-f763a3d1ef29 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:23:39 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-9cb65653-e103-4087-be97-f763a3d1ef29 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Deleted volume successfully. Jul 22 12:23:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9cb65653-e103-4087-be97-f763a3d1ef29 tempest-TestServerVolumeAttachmentScenario-1036386495 None] Lock "cinder-52cdf900-7078-4d13-8eb8-a50beb34319c-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:23:43 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:23:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Flow 'volume_create_manager' (b57137e9-8e44-4850-9087-f3382d540f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:23:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f397c0-3cfe-4d07-a021-0113142474d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f397c0-3cfe-4d07-a021-0113142474d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=044775ef-64c7-4d5d-b4b2-54efdd7b0b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b2387712c2a485eac8f1233b2b2ede0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:23:43Z,use_quota=True,user_id='d3d8ea920b424f18b899dc5a3468ab8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a92b621-21eb-4fc2-98c7-7e04e1aea6d0),volume_type_id=8a92b621-21eb-4fc2-98c7-7e04e1aea6d0)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70dc53cc-0390-409a-a72d-864ecadc2bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70dc53cc-0390-409a-a72d-864ecadc2bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be3501a-3064-4f16-98fb-c876283a73e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:43 devstack cinder-volume[87568]: DEBUG cinder.image.glance [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Creating Keystone auth plugin from conf {{(pid=87568) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 12:23:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be3501a-3064-4f16-98fb-c876283a73e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '044775ef-64c7-4d5d-b4b2-54efdd7b0b8e', 'volume_name': 'volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e', 'volume_size': 1, 'image_id': '1027be22-4c17-411d-a40d-615b444b8e85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1027be22-4c17-411d-a40d-615b444b8e85', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f41c62a02b82cc13a7acf7ecc505c165', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0b2387712c2a485eac8f1233b2b2ede0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '31b3f6463d46095e844ea8e51dfd15cdcb9b67ecf5e6b9b69eada2337710fc51e7b96b17f3634648d3830758237daaa8277cf5a4aa012d9146556eb227191292', 'id': '1027be22-4c17-411d-a40d-615b444b8e85', 'created_at': datetime.datetime(2026, 7, 22, 10, 23, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1027be22-4c17-411d-a40d-615b444b8e85/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8cf0a9-2470-4e25-b82c-c55052d475b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8cf0a9-2470-4e25-b82c-c55052d475b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36eeb432-db64-4096-844a-96f0a56e3b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:43 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Volume 044775ef-64c7-4d5d-b4b2-54efdd7b0b8e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e', 'volume_size': 1, 'image_id': '1027be22-4c17-411d-a40d-615b444b8e85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1027be22-4c17-411d-a40d-615b444b8e85', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f41c62a02b82cc13a7acf7ecc505c165', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0b2387712c2a485eac8f1233b2b2ede0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '31b3f6463d46095e844ea8e51dfd15cdcb9b67ecf5e6b9b69eada2337710fc51e7b96b17f3634648d3830758237daaa8277cf5a4aa012d9146556eb227191292', 'id': '1027be22-4c17-411d-a40d-615b444b8e85', 'created_at': datetime.datetime(2026, 7, 22, 10, 23, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1027be22-4c17-411d-a40d-615b444b8e85/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 22 12:23:43 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Trying to clone 044775ef-64c7-4d5d-b4b2-54efdd7b0b8e from image 1027be22-4c17-411d-a40d-615b444b8e85 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1027be22-4c17-411d-a40d-615b444b8e85', 'metadata': {}}]). {{(pid=87568) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 12:23:43 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 12:23:43 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Image download 0.00 MB at 0.00 MB/s Jul 22 12:23:43 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f72636-e8d3-4e74-907a-ed2df1821801]: (4, 'raw') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:23:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:43 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD Jul 22 12:23:43 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:44 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:44 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD Jul 22 12:23:44 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:44 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD" returned: 1 in 0.324s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:23:44 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Temporary image 1027be22-4c17-411d-a40d-615b444b8e85 is fetched for user d3d8ea920b424f18b899dc5a3468ab8b. {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 12:23:44 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b68f51f-2f70-4a56-853c-77276d5f8780]: (4, 'raw') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:23:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:44 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD Jul 22 12:23:44 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:44 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:45 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD Jul 22 12:23:45 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:45 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD" returned: 1 in 0.392s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:23:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=044775ef-64c7-4d5d-b4b2-54efdd7b0b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b2387712c2a485eac8f1233b2b2ede0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:23:43Z,use_quota=True,user_id='d3d8ea920b424f18b899dc5a3468ab8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a92b621-21eb-4fc2-98c7-7e04e1aea6d0),volume_type_id=8a92b621-21eb-4fc2-98c7-7e04e1aea6d0)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:23:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Creating volume 044775ef-64c7-4d5d-b4b2-54efdd7b0b8e {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:23:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:23:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:23:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:23:45 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:23:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:45 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e 1073741824 Jul 22 12:23:45 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:45 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e 1073741824" returned: 0 in 0.473s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:45 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e Jul 22 12:23:45 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:46 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e" returned: 0 in 0.263s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:46 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:23:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:46 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Attempting download of 1027be22-4c17-411d-a40d-615b444b8e85 ((None, [{'url': 'file:///opt/stack/data/glance/images/1027be22-4c17-411d-a40d-615b444b8e85', 'metadata': {}}])) to volume 044775ef-64c7-4d5d-b4b2-54efdd7b0b8e. {{(pid=87568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 12:23:46 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac41bf5-56c7-4ce8-8bf6-c789bef1e6e9]: (4, 'raw') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:23:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1027be22-4c17-411d-a40d-615b444b8e85_l5j61yq_ {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:46 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1027be22-4c17-411d-a40d-615b444b8e85_l5j61yq_ Jul 22 12:23:46 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:46 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1027be22-4c17-411d-a40d-615b444b8e85_l5j61yq_" returned: 0 in 0.343s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1027be22-4c17-411d-a40d-615b444b8e85_l5j61yq_ {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:46 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1027be22-4c17-411d-a40d-615b444b8e85_l5j61yq_ Jul 22 12:23:46 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:46 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1027be22-4c17-411d-a40d-615b444b8e85_l5j61yq_" returned: 1 in 0.338s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1027be22-4c17-411d-a40d-615b444b8e85_l5j61yq_' failed. Not Retrying. {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:23:46 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[144426a2-4767-4deb-9475-c7a9a242bfb7]: (4, 'raw') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:23:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:47 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD Jul 22 12:23:47 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:47 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:47 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD Jul 22 12:23:47 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:47 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:23:47 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] 1027be22-4c17-411d-a40d-615b444b8e85 was raw, converting to qcow2 {{(pid=87568) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 12:23:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:47 devstack sudo[103122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e Jul 22 12:23:47 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:48 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e" returned: 0 in 0.606s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:48 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1027be22-4c17-411d-a40d-615b444b8e85_a33qkl0qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:23:48 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Converted 0.00 MB image at 0.00 MB/s Jul 22 12:23:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:48 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e 1G Jul 22 12:23:48 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:48 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e 1G" returned: 0 in 0.359s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:48 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Downloaded image 1027be22-4c17-411d-a40d-615b444b8e85 ((None, [{'url': 'file:///opt/stack/data/glance/images/1027be22-4c17-411d-a40d-615b444b8e85', 'metadata': {}}])) to volume 044775ef-64c7-4d5d-b4b2-54efdd7b0b8e successfully. {{(pid=87568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 12:23:48 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Temporary image 1027be22-4c17-411d-a40d-615b444b8e85 for user d3d8ea920b424f18b899dc5a3468ab8b is deleted. {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 12:23:48 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Marking volume 044775ef-64c7-4d5d-b4b2-54efdd7b0b8e as bootable. {{(pid=87568) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 12:23:48 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Copying metadata from image 1027be22-4c17-411d-a40d-615b444b8e85 to 044775ef-64c7-4d5d-b4b2-54efdd7b0b8e. {{(pid=87568) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 12:23:48 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Creating volume glance metadata for volume 044775ef-64c7-4d5d-b4b2-54efdd7b0b8e backed by image 1027be22-4c17-411d-a40d-615b444b8e85 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1027be22-4c17-411d-a40d-615b444b8e85', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f41c62a02b82cc13a7acf7ecc505c165', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87568) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 12:23:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36eeb432-db64-4096-844a-96f0a56e3b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e', 'volume_size': 1, 'image_id': '1027be22-4c17-411d-a40d-615b444b8e85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1027be22-4c17-411d-a40d-615b444b8e85', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f41c62a02b82cc13a7acf7ecc505c165', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0b2387712c2a485eac8f1233b2b2ede0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '31b3f6463d46095e844ea8e51dfd15cdcb9b67ecf5e6b9b69eada2337710fc51e7b96b17f3634648d3830758237daaa8277cf5a4aa012d9146556eb227191292', 'id': '1027be22-4c17-411d-a40d-615b444b8e85', 'created_at': datetime.datetime(2026, 7, 22, 10, 23, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1027be22-4c17-411d-a40d-615b444b8e85/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f12777b6-c205-4f9a-a4bd-bb7b81946f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:48 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Volume volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e (044775ef-64c7-4d5d-b4b2-54efdd7b0b8e): created successfully Jul 22 12:23:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f12777b6-c205-4f9a-a4bd-bb7b81946f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:48 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Flow 'volume_create_manager' (b57137e9-8e44-4850-9087-f3382d540f77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:23:48 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-f54c6d25-430c-4529-b9f1-40ad4798d2dc tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Created volume successfully. Jul 22 12:23:49 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-51806905-1f12-479b-a438-f0e44ba929a6 tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Acquiring lock "cinder-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:23:49 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-51806905-1f12-479b-a438-f0e44ba929a6 tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Lock "cinder-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:23:49 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-51806905-1f12-479b-a438-f0e44ba929a6 tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Acquiring lock "cinder-quobyte-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:23:49 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-51806905-1f12-479b-a438-f0e44ba929a6 tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Lock "cinder-quobyte-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e" acquired by "delete_volume" :: waited 0.023s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:23:49 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f67022-06e2-48a1-8b08-88b2ac8b55d9]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:23:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-51806905-1f12-479b-a438-f0e44ba929a6 tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Flow 'volume_create_manager' (ad1388de-0e39-42da-abc5-5ccdcef4ff75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85583b82-3ac9-4f57-9a82-9f03355aca6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85583b82-3ac9-4f57-9a82-9f03355aca6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2099104209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38aa3436-20e5-4b2a-8faa-6ce688563bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226537fdb8eb4804bcc0d81c26e45513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:23:50Z,use_quota=True,user_id='425a574ed8cf467fbd46dcabcea18cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c435ab3-ab3b-421b-8880-caef10356ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c435ab3-ab3b-421b-8880-caef10356ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862c9503-19b6-4a0a-9e46-33e72e510e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862c9503-19b6-4a0a-9e46-33e72e510e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38aa3436-20e5-4b2a-8faa-6ce688563bd0', 'volume_name': 'volume-38aa3436-20e5-4b2a-8faa-6ce688563bd0', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b85adc-445b-41cf-8914-821243b969d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b85adc-445b-41cf-8914-821243b969d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df787558-6f4d-4929-97bf-6d3d4f5a4508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:50 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Volume 38aa3436-20e5-4b2a-8faa-6ce688563bd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38aa3436-20e5-4b2a-8faa-6ce688563bd0', 'volume_size': 1} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2099104209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38aa3436-20e5-4b2a-8faa-6ce688563bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226537fdb8eb4804bcc0d81c26e45513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:23:50Z,use_quota=True,user_id='425a574ed8cf467fbd46dcabcea18cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Creating volume 38aa3436-20e5-4b2a-8faa-6ce688563bd0 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:23:50 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e Jul 22 12:23:50 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:23:50 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-38aa3436-20e5-4b2a-8faa-6ce688563bd0 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:50 devstack sudo[103144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-38aa3436-20e5-4b2a-8faa-6ce688563bd0 1073741824 Jul 22 12:23:50 devstack sudo[103144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:23:50 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Flow 'volume_create_manager' (9fba469d-5694-4954-a904-3895d331052b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa50e75-c1f8-4d4b-b83b-5d268336b7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-51806905-1f12-479b-a438-f0e44ba929a6 tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e" returned: 0 in 0.477s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-51806905-1f12-479b-a438-f0e44ba929a6 tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa50e75-c1f8-4d4b-b83b-5d268336b7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1765946094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f9fc09-ff09-495b-ade4-2263d6512fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226537fdb8eb4804bcc0d81c26e45513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:23:50Z,use_quota=True,user_id='425a574ed8cf467fbd46dcabcea18cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcefb8b-58cd-42de-821c-c6960c193ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcefb8b-58cd-42de-821c-c6960c193ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:50 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e Jul 22 12:23:50 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6095b362-25b7-410c-b30c-ef7509f28af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6095b362-25b7-410c-b30c-ef7509f28af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f9fc09-ff09-495b-ade4-2263d6512fc3', 'volume_name': 'volume-34f9fc09-ff09-495b-ade4-2263d6512fc3', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c9846e-f91f-4914-bfb2-cfc69f21c8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c9846e-f91f-4914-bfb2-cfc69f21c8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d37aaab-8e68-4ea4-83a3-083ea01a22df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:50 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Volume 34f9fc09-ff09-495b-ade4-2263d6512fc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f9fc09-ff09-495b-ade4-2263d6512fc3', 'volume_size': 1} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:50 devstack sudo[103144]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-38aa3436-20e5-4b2a-8faa-6ce688563bd0 1073741824" returned: 0 in 0.540s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-38aa3436-20e5-4b2a-8faa-6ce688563bd0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:50 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-38aa3436-20e5-4b2a-8faa-6ce688563bd0 Jul 22 12:23:50 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:50 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-51806905-1f12-479b-a438-f0e44ba929a6 tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e" returned: 0 in 0.315s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-51806905-1f12-479b-a438-f0e44ba929a6 tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Lock "cinder-quobyte-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e" released by "delete_volume" :: held 0.867s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Flow 'volume_create_manager' (1b95f9e3-4d8b-4117-8c9b-6d18e7ce6774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eee788b-63fa-44ba-96fd-4e8e47ec8f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eee788b-63fa-44ba-96fd-4e8e47ec8f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-188174487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2611bc6c-2604-4465-a7b4-a50b2752b46d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226537fdb8eb4804bcc0d81c26e45513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:23:51Z,use_quota=True,user_id='425a574ed8cf467fbd46dcabcea18cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af6b247-7bbb-4dcf-8bfb-b9a63a80d208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af6b247-7bbb-4dcf-8bfb-b9a63a80d208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27638896-5ca7-4538-bfff-b819afdaff2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27638896-5ca7-4538-bfff-b819afdaff2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2611bc6c-2604-4465-a7b4-a50b2752b46d', 'volume_name': 'volume-2611bc6c-2604-4465-a7b4-a50b2752b46d', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd55dc62-a6f8-4aaf-a2ea-ac9c31f89461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd55dc62-a6f8-4aaf-a2ea-ac9c31f89461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb5a390e-f332-4b1f-a49f-0d5206107497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:50 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Volume 2611bc6c-2604-4465-a7b4-a50b2752b46d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2611bc6c-2604-4465-a7b4-a50b2752b46d', 'volume_size': 1} Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:50 devstack cinder-volume[87568]: WARNING cinder.quota [None req-51806905-1f12-479b-a438-f0e44ba929a6 tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:23:50 devstack cinder-volume[87568]: WARNING cinder.quota [None req-51806905-1f12-479b-a438-f0e44ba929a6 tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 22 12:23:50 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-51806905-1f12-479b-a438-f0e44ba929a6 tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Created reservations ['8d5410c0-e41f-4726-b06b-3c53b02f5f93', 'df67371b-5aa3-4c1e-9e99-26f12f747c3c', 'ff11aff3-a231-4842-a927-6f9f26af85cc', '85c28cf8-1624-4aeb-8e8a-fc86ae5dae19'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:23:51 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-38aa3436-20e5-4b2a-8faa-6ce688563bd0" returned: 0 in 0.316s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.528s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1765946094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f9fc09-ff09-495b-ade4-2263d6512fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226537fdb8eb4804bcc0d81c26e45513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:23:50Z,use_quota=True,user_id='425a574ed8cf467fbd46dcabcea18cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Creating volume 34f9fc09-ff09-495b-ade4-2263d6512fc3 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:23:51 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-34f9fc09-ff09-495b-ade4-2263d6512fc3 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df787558-6f4d-4929-97bf-6d3d4f5a4508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38aa3436-20e5-4b2a-8faa-6ce688563bd0', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0004d9-1f4e-4f37-aa80-523af3babc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:51 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-34f9fc09-ff09-495b-ade4-2263d6512fc3 1073741824 Jul 22 12:23:51 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-51806905-1f12-479b-a438-f0e44ba929a6 tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-51806905-1f12-479b-a438-f0e44ba929a6 tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-51806905-1f12-479b-a438-f0e44ba929a6 tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-51806905-1f12-479b-a438-f0e44ba929a6 tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-51806905-1f12-479b-a438-f0e44ba929a6 tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-51806905-1f12-479b-a438-f0e44ba929a6 tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:51 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Volume volume-38aa3436-20e5-4b2a-8faa-6ce688563bd0 (38aa3436-20e5-4b2a-8faa-6ce688563bd0): created successfully Jul 22 12:23:51 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0004d9-1f4e-4f37-aa80-523af3babc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:51 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Flow 'volume_create_manager' (ad1388de-0e39-42da-abc5-5ccdcef4ff75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:23:51 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-ae9c3eec-1814-4ed1-b3ed-fd64a04d1d6b tempest-CreateVolumesFromImageTest-524251073 None] Created volume successfully. Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Flow 'volume_create_manager' (a5a06a21-0249-4f84-a435-72c4fde77b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9bd945e-f66f-4fc9-89fb-384ce91f45a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9bd945e-f66f-4fc9-89fb-384ce91f45a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1394953398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeec5ddc-c93b-433f-9d34-e2dcb18248bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226537fdb8eb4804bcc0d81c26e45513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:23:51Z,use_quota=True,user_id='425a574ed8cf467fbd46dcabcea18cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f63208-bc0d-414a-8e3b-b54d43cb48eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f63208-bc0d-414a-8e3b-b54d43cb48eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63c000fa-fc39-4002-b565-d27f74bc9f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63c000fa-fc39-4002-b565-d27f74bc9f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeec5ddc-c93b-433f-9d34-e2dcb18248bc', 'volume_name': 'volume-eeec5ddc-c93b-433f-9d34-e2dcb18248bc', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec23ed6-ac24-4287-b507-b74b07202ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec23ed6-ac24-4287-b507-b74b07202ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e38722-9612-40f8-8cd9-1afa624d30be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:51 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Volume eeec5ddc-c93b-433f-9d34-e2dcb18248bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeec5ddc-c93b-433f-9d34-e2dcb18248bc', 'volume_size': 1} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:51 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-51806905-1f12-479b-a438-f0e44ba929a6 tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.280s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-51806905-1f12-479b-a438-f0e44ba929a6 tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:23:51 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-51806905-1f12-479b-a438-f0e44ba929a6 tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Deleted volume successfully. Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-51806905-1f12-479b-a438-f0e44ba929a6 tempest-VolumeAndVolumeTypeFromImageTest-1475581939 None] Lock "cinder-044775ef-64c7-4d5d-b4b2-54efdd7b0b8e-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:23:51 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-34f9fc09-ff09-495b-ade4-2263d6512fc3 1073741824" returned: 0 in 0.611s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Flow 'volume_create_manager' (b48029d5-0318-4622-b8a7-97d3dd2a8e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b0f430-625a-4f67-b1eb-28550a2d88d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b0f430-625a-4f67-b1eb-28550a2d88d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2102054027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a09c9489-a45e-4790-8eaa-b438cff7f507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226537fdb8eb4804bcc0d81c26e45513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:23:52Z,use_quota=True,user_id='425a574ed8cf467fbd46dcabcea18cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35aeb617-aadc-4d8c-89b8-d2dd0d86904b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35aeb617-aadc-4d8c-89b8-d2dd0d86904b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47335d4-f37e-490c-a908-720c7c4953f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47335d4-f37e-490c-a908-720c7c4953f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a09c9489-a45e-4790-8eaa-b438cff7f507', 'volume_name': 'volume-a09c9489-a45e-4790-8eaa-b438cff7f507', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4278c003-d723-42f4-a39b-54e718dac6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4278c003-d723-42f4-a39b-54e718dac6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a18ddfd-95a4-4a7c-b16f-e50bd393779d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:51 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Volume a09c9489-a45e-4790-8eaa-b438cff7f507: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a09c9489-a45e-4790-8eaa-b438cff7f507', 'volume_size': 1} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:51 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-34f9fc09-ff09-495b-ade4-2263d6512fc3 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:51 devstack sudo[103172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-34f9fc09-ff09-495b-ade4-2263d6512fc3 Jul 22 12:23:51 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:52 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-34f9fc09-ff09-495b-ade4-2263d6512fc3" returned: 0 in 0.256s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.097s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-188174487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2611bc6c-2604-4465-a7b4-a50b2752b46d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226537fdb8eb4804bcc0d81c26e45513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:23:51Z,use_quota=True,user_id='425a574ed8cf467fbd46dcabcea18cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Creating volume 2611bc6c-2604-4465-a7b4-a50b2752b46d {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:23:52 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2611bc6c-2604-4465-a7b4-a50b2752b46d 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d37aaab-8e68-4ea4-83a3-083ea01a22df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f9fc09-ff09-495b-ade4-2263d6512fc3', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e3a729b-4d88-49c2-8077-ef742fd9eab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:52 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2611bc6c-2604-4465-a7b4-a50b2752b46d 1073741824 Jul 22 12:23:52 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:52 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Volume volume-34f9fc09-ff09-495b-ade4-2263d6512fc3 (34f9fc09-ff09-495b-ade4-2263d6512fc3): created successfully Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e3a729b-4d88-49c2-8077-ef742fd9eab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Flow 'volume_create_manager' (9fba469d-5694-4954-a904-3895d331052b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:23:52 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-f858ad0c-e0ee-4739-83e4-18de6ca82ca3 tempest-CreateVolumesFromImageTest-524251073 None] Created volume successfully. Jul 22 12:23:52 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2611bc6c-2604-4465-a7b4-a50b2752b46d 1073741824" returned: 0 in 0.549s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2611bc6c-2604-4465-a7b4-a50b2752b46d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:52 devstack sudo[103181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2611bc6c-2604-4465-a7b4-a50b2752b46d Jul 22 12:23:52 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:52 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2611bc6c-2604-4465-a7b4-a50b2752b46d" returned: 0 in 0.277s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.564s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1394953398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeec5ddc-c93b-433f-9d34-e2dcb18248bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226537fdb8eb4804bcc0d81c26e45513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:23:51Z,use_quota=True,user_id='425a574ed8cf467fbd46dcabcea18cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Creating volume eeec5ddc-c93b-433f-9d34-e2dcb18248bc {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:23:52 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:23:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-eeec5ddc-c93b-433f-9d34-e2dcb18248bc 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:52 devstack sudo[103184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-eeec5ddc-c93b-433f-9d34-e2dcb18248bc 1073741824 Jul 22 12:23:52 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb5a390e-f332-4b1f-a49f-0d5206107497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2611bc6c-2604-4465-a7b4-a50b2752b46d', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d6b8eb-4a9d-4bc1-b133-026bc0694720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:53 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Volume volume-2611bc6c-2604-4465-a7b4-a50b2752b46d (2611bc6c-2604-4465-a7b4-a50b2752b46d): created successfully Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d6b8eb-4a9d-4bc1-b133-026bc0694720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Flow 'volume_create_manager' (1b95f9e3-4d8b-4117-8c9b-6d18e7ce6774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:23:53 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-6a230798-19bd-4676-8e52-317d6c1b5af7 tempest-CreateVolumesFromImageTest-524251073 None] Created volume successfully. Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Flow 'volume_create_manager' (6e8902a0-4027-4ac8-8a9e-1691f52825e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e65388-fa94-45b9-bcc4-d6dda4148b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e65388-fa94-45b9-bcc4-d6dda4148b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1839985937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21c82f0-42b0-4917-8b05-43a6ce326d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27886cbfda0e45519c6d8eb1693b739a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:23:53Z,use_quota=True,user_id='076fb2e48861415892f685ce6ea9cd30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b916fe-3a80-4e26-85d3-cf1bbcbc422b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b916fe-3a80-4e26-85d3-cf1bbcbc422b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6323f09-7de7-49b5-b72f-8d756fb2fd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6323f09-7de7-49b5-b72f-8d756fb2fd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b21c82f0-42b0-4917-8b05-43a6ce326d64', 'volume_name': 'volume-b21c82f0-42b0-4917-8b05-43a6ce326d64', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6311951c-5e38-4534-bb21-cd9acc74e3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6311951c-5e38-4534-bb21-cd9acc74e3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8dfb46-4c8f-4db4-adca-ec96c4f59a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:53 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Volume b21c82f0-42b0-4917-8b05-43a6ce326d64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b21c82f0-42b0-4917-8b05-43a6ce326d64', 'volume_size': 1} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:53 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-eeec5ddc-c93b-433f-9d34-e2dcb18248bc 1073741824" returned: 0 in 0.500s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-eeec5ddc-c93b-433f-9d34-e2dcb18248bc {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:53 devstack sudo[103190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-eeec5ddc-c93b-433f-9d34-e2dcb18248bc Jul 22 12:23:53 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:53 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-eeec5ddc-c93b-433f-9d34-e2dcb18248bc" returned: 0 in 0.265s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.979s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2102054027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a09c9489-a45e-4790-8eaa-b438cff7f507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226537fdb8eb4804bcc0d81c26e45513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:23:52Z,use_quota=True,user_id='425a574ed8cf467fbd46dcabcea18cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Creating volume a09c9489-a45e-4790-8eaa-b438cff7f507 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:23:53 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a09c9489-a45e-4790-8eaa-b438cff7f507 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e38722-9612-40f8-8cd9-1afa624d30be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeec5ddc-c93b-433f-9d34-e2dcb18248bc', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:53 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a09c9489-a45e-4790-8eaa-b438cff7f507 1073741824 Jul 22 12:23:53 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69842953-9f3a-4d08-a2fd-bb4c365b0e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:53 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Volume volume-eeec5ddc-c93b-433f-9d34-e2dcb18248bc (eeec5ddc-c93b-433f-9d34-e2dcb18248bc): created successfully Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69842953-9f3a-4d08-a2fd-bb4c365b0e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:53 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Flow 'volume_create_manager' (a5a06a21-0249-4f84-a435-72c4fde77b1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:23:53 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-009e84b8-e0e6-4a63-b6b1-a260af6499aa tempest-CreateVolumesFromImageTest-524251073 None] Created volume successfully. Jul 22 12:23:54 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a09c9489-a45e-4790-8eaa-b438cff7f507 1073741824" returned: 0 in 0.503s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a09c9489-a45e-4790-8eaa-b438cff7f507 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:54 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a09c9489-a45e-4790-8eaa-b438cff7f507 Jul 22 12:23:54 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:54 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a09c9489-a45e-4790-8eaa-b438cff7f507" returned: 0 in 0.282s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:54 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:23:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.323s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:54 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1839985937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21c82f0-42b0-4917-8b05-43a6ce326d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27886cbfda0e45519c6d8eb1693b739a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:23:53Z,use_quota=True,user_id='076fb2e48861415892f685ce6ea9cd30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:23:54 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Creating volume b21c82f0-42b0-4917-8b05-43a6ce326d64 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:23:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:54 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:23:54 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:23:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:54 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:23:54 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:23:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b21c82f0-42b0-4917-8b05-43a6ce326d64 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:54 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b21c82f0-42b0-4917-8b05-43a6ce326d64 1073741824 Jul 22 12:23:54 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:54 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a18ddfd-95a4-4a7c-b16f-e50bd393779d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a09c9489-a45e-4790-8eaa-b438cff7f507', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:54 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012704e5-6927-4b14-aa22-b12374b7bd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:54 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Volume volume-a09c9489-a45e-4790-8eaa-b438cff7f507 (a09c9489-a45e-4790-8eaa-b438cff7f507): created successfully Jul 22 12:23:54 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012704e5-6927-4b14-aa22-b12374b7bd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:54 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Flow 'volume_create_manager' (b48029d5-0318-4622-b8a7-97d3dd2a8e99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:23:54 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-0e6b7196-75d2-44d7-898a-0d6eecb08ead tempest-CreateVolumesFromImageTest-524251073 None] Created volume successfully. Jul 22 12:23:55 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b21c82f0-42b0-4917-8b05-43a6ce326d64 1073741824" returned: 0 in 0.464s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b21c82f0-42b0-4917-8b05-43a6ce326d64 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:55 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b21c82f0-42b0-4917-8b05-43a6ce326d64 Jul 22 12:23:55 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4045549b-6c7b-49e6-9709-ef046b099ff9 tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "cinder-a09c9489-a45e-4790-8eaa-b438cff7f507-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:23:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4045549b-6c7b-49e6-9709-ef046b099ff9 tempest-CreateVolumesFromImageTest-524251073 None] Lock "cinder-a09c9489-a45e-4790-8eaa-b438cff7f507-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:23:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4045549b-6c7b-49e6-9709-ef046b099ff9 tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "cinder-quobyte-a09c9489-a45e-4790-8eaa-b438cff7f507" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:23:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4045549b-6c7b-49e6-9709-ef046b099ff9 tempest-CreateVolumesFromImageTest-524251073 None] Lock "cinder-quobyte-a09c9489-a45e-4790-8eaa-b438cff7f507" acquired by "delete_volume" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:23:55 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b203d7c-33ec-43d8-b315-e89810df460a]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:23:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4045549b-6c7b-49e6-9709-ef046b099ff9 tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a09c9489-a45e-4790-8eaa-b438cff7f507 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:55 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b21c82f0-42b0-4917-8b05-43a6ce326d64" returned: 0 in 0.305s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:55 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:23:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8dfb46-4c8f-4db4-adca-ec96c4f59a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b21c82f0-42b0-4917-8b05-43a6ce326d64', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622e4944-65f6-4b46-b281-7c4a3cf80271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:55 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Volume volume-b21c82f0-42b0-4917-8b05-43a6ce326d64 (b21c82f0-42b0-4917-8b05-43a6ce326d64): created successfully Jul 22 12:23:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622e4944-65f6-4b46-b281-7c4a3cf80271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Flow 'volume_create_manager' (6e8902a0-4027-4ac8-8a9e-1691f52825e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:23:55 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a09c9489-a45e-4790-8eaa-b438cff7f507 Jul 22 12:23:55 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:55 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-bdf4f6fd-8d44-42bd-be73-a9eb490fd5ef tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Created volume successfully. Jul 22 12:23:55 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4045549b-6c7b-49e6-9709-ef046b099ff9 tempest-CreateVolumesFromImageTest-524251073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a09c9489-a45e-4790-8eaa-b438cff7f507" returned: 0 in 0.393s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4045549b-6c7b-49e6-9709-ef046b099ff9 tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a09c9489-a45e-4790-8eaa-b438cff7f507 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:55 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a09c9489-a45e-4790-8eaa-b438cff7f507 Jul 22 12:23:55 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:55 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4045549b-6c7b-49e6-9709-ef046b099ff9 tempest-CreateVolumesFromImageTest-524251073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a09c9489-a45e-4790-8eaa-b438cff7f507" returned: 0 in 0.251s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4045549b-6c7b-49e6-9709-ef046b099ff9 tempest-CreateVolumesFromImageTest-524251073 None] Lock "cinder-quobyte-a09c9489-a45e-4790-8eaa-b438cff7f507" released by "delete_volume" :: held 0.690s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-4045549b-6c7b-49e6-9709-ef046b099ff9 tempest-CreateVolumesFromImageTest-524251073 None] Created reservations ['f9d4b197-45c6-4e54-a840-edcdfe12a349', '2280a720-d1ec-4584-80f9-0df4b66470a0', '4c6e9a8b-cc82-49b3-806b-5746fcd092d7', 'c38a7aaf-9e0f-4187-b3d4-f9ec6373abb4'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4045549b-6c7b-49e6-9709-ef046b099ff9 tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4045549b-6c7b-49e6-9709-ef046b099ff9 tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4045549b-6c7b-49e6-9709-ef046b099ff9 tempest-CreateVolumesFromImageTest-524251073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4045549b-6c7b-49e6-9709-ef046b099ff9 tempest-CreateVolumesFromImageTest-524251073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4045549b-6c7b-49e6-9709-ef046b099ff9 tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4045549b-6c7b-49e6-9709-ef046b099ff9 tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:56 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:23:56 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ded88d36-cc52-48f7-a0a8-178fefd45ba8 tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "cinder-eeec5ddc-c93b-433f-9d34-e2dcb18248bc-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ded88d36-cc52-48f7-a0a8-178fefd45ba8 tempest-CreateVolumesFromImageTest-524251073 None] Lock "cinder-eeec5ddc-c93b-433f-9d34-e2dcb18248bc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:23:56 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4045549b-6c7b-49e6-9709-ef046b099ff9 tempest-CreateVolumesFromImageTest-524251073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.353s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-4045549b-6c7b-49e6-9709-ef046b099ff9 tempest-CreateVolumesFromImageTest-524251073 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:23:56 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-4045549b-6c7b-49e6-9709-ef046b099ff9 tempest-CreateVolumesFromImageTest-524251073 None] Deleted volume successfully. Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ded88d36-cc52-48f7-a0a8-178fefd45ba8 tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "cinder-quobyte-eeec5ddc-c93b-433f-9d34-e2dcb18248bc" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4045549b-6c7b-49e6-9709-ef046b099ff9 tempest-CreateVolumesFromImageTest-524251073 None] Lock "cinder-a09c9489-a45e-4790-8eaa-b438cff7f507-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ded88d36-cc52-48f7-a0a8-178fefd45ba8 tempest-CreateVolumesFromImageTest-524251073 None] Lock "cinder-quobyte-eeec5ddc-c93b-433f-9d34-e2dcb18248bc" acquired by "delete_volume" :: waited 0.022s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cdc3be-f85d-43b9-a83c-ec3032da0e79]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ded88d36-cc52-48f7-a0a8-178fefd45ba8 tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-eeec5ddc-c93b-433f-9d34-e2dcb18248bc {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:56 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-eeec5ddc-c93b-433f-9d34-e2dcb18248bc Jul 22 12:23:56 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Flow 'volume_create_manager' (f3d3ad5a-23d8-40c5-9492-d2273e023878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88393a69-68ea-448a-b28e-cff8c739df3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88393a69-68ea-448a-b28e-cff8c739df3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-46729817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cabd2a42-6365-4ea3-a03a-ccb3aa19f181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe0296f94e2461895730f9c8a0de7c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:23:57Z,use_quota=True,user_id='717e05d7e52c43669cceffe087ef013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0eeb0ec-7089-42be-b8d2-451171570791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0eeb0ec-7089-42be-b8d2-451171570791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7700f09-f787-4af5-8ac1-b3fde8b5d50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7700f09-f787-4af5-8ac1-b3fde8b5d50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cabd2a42-6365-4ea3-a03a-ccb3aa19f181', 'volume_name': 'volume-cabd2a42-6365-4ea3-a03a-ccb3aa19f181', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd8e73d-28ed-4933-91a1-1f32d73769df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd8e73d-28ed-4933-91a1-1f32d73769df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7202fdab-49a1-491a-ba1f-a2c4d8eb2c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:56 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Volume cabd2a42-6365-4ea3-a03a-ccb3aa19f181: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cabd2a42-6365-4ea3-a03a-ccb3aa19f181', 'volume_size': 1} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-46729817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cabd2a42-6365-4ea3-a03a-ccb3aa19f181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe0296f94e2461895730f9c8a0de7c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:23:57Z,use_quota=True,user_id='717e05d7e52c43669cceffe087ef013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Creating volume cabd2a42-6365-4ea3-a03a-ccb3aa19f181 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:23:56 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:23:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cabd2a42-6365-4ea3-a03a-ccb3aa19f181 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:56 devstack sudo[103227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cabd2a42-6365-4ea3-a03a-ccb3aa19f181 1073741824 Jul 22 12:23:56 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:57 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ded88d36-cc52-48f7-a0a8-178fefd45ba8 tempest-CreateVolumesFromImageTest-524251073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-eeec5ddc-c93b-433f-9d34-e2dcb18248bc" returned: 0 in 0.420s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ded88d36-cc52-48f7-a0a8-178fefd45ba8 tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-eeec5ddc-c93b-433f-9d34-e2dcb18248bc {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:57 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-eeec5ddc-c93b-433f-9d34-e2dcb18248bc Jul 22 12:23:57 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:57 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ded88d36-cc52-48f7-a0a8-178fefd45ba8 tempest-CreateVolumesFromImageTest-524251073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-eeec5ddc-c93b-433f-9d34-e2dcb18248bc" returned: 0 in 0.290s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ded88d36-cc52-48f7-a0a8-178fefd45ba8 tempest-CreateVolumesFromImageTest-524251073 None] Lock "cinder-quobyte-eeec5ddc-c93b-433f-9d34-e2dcb18248bc" released by "delete_volume" :: held 0.771s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-ded88d36-cc52-48f7-a0a8-178fefd45ba8 tempest-CreateVolumesFromImageTest-524251073 None] Created reservations ['dd1c02f5-e240-458a-9a4f-d4bfbd1aff72', 'fdb557a3-89b0-4d72-b938-374acabcb8ed', '599019db-8549-4e3a-9b31-d88d1874d1b6', '81aa7759-6a4a-455d-bb27-3898fe2882e4'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-f2085282-ff58-493e-a6e6-d17c2f4b5e1a req-0186b02b-c252-4ee1-a61c-5d6014aa8f10 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:57 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cabd2a42-6365-4ea3-a03a-ccb3aa19f181 1073741824" returned: 0 in 0.542s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cabd2a42-6365-4ea3-a03a-ccb3aa19f181 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ded88d36-cc52-48f7-a0a8-178fefd45ba8 tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ded88d36-cc52-48f7-a0a8-178fefd45ba8 tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ded88d36-cc52-48f7-a0a8-178fefd45ba8 tempest-CreateVolumesFromImageTest-524251073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ded88d36-cc52-48f7-a0a8-178fefd45ba8 tempest-CreateVolumesFromImageTest-524251073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ded88d36-cc52-48f7-a0a8-178fefd45ba8 tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ded88d36-cc52-48f7-a0a8-178fefd45ba8 tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:57 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cabd2a42-6365-4ea3-a03a-ccb3aa19f181 Jul 22 12:23:57 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:57 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:23:57 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0fc412b4-f143-4036-9561-b7eb9448aa1f tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "cinder-2611bc6c-2604-4465-a7b4-a50b2752b46d-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0fc412b4-f143-4036-9561-b7eb9448aa1f tempest-CreateVolumesFromImageTest-524251073 None] Lock "cinder-2611bc6c-2604-4465-a7b4-a50b2752b46d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0fc412b4-f143-4036-9561-b7eb9448aa1f tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "cinder-quobyte-2611bc6c-2604-4465-a7b4-a50b2752b46d" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:23:57 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0fc412b4-f143-4036-9561-b7eb9448aa1f tempest-CreateVolumesFromImageTest-524251073 None] Lock "cinder-quobyte-2611bc6c-2604-4465-a7b4-a50b2752b46d" acquired by "delete_volume" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:23:57 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cabd2a42-6365-4ea3-a03a-ccb3aa19f181" returned: 0 in 0.311s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-f2085282-ff58-493e-a6e6-d17c2f4b5e1a req-0186b02b-c252-4ee1-a61c-5d6014aa8f10 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.378s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ded88d36-cc52-48f7-a0a8-178fefd45ba8 tempest-CreateVolumesFromImageTest-524251073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.300s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-ded88d36-cc52-48f7-a0a8-178fefd45ba8 tempest-CreateVolumesFromImageTest-524251073 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37c7be4-5542-4c50-b413-6a77bd5efad7]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0fc412b4-f143-4036-9561-b7eb9448aa1f tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2611bc6c-2604-4465-a7b4-a50b2752b46d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7202fdab-49a1-491a-ba1f-a2c4d8eb2c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cabd2a42-6365-4ea3-a03a-ccb3aa19f181', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc63d45a-e068-45ec-b19a-e611fe4c7621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:57 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-ded88d36-cc52-48f7-a0a8-178fefd45ba8 tempest-CreateVolumesFromImageTest-524251073 None] Deleted volume successfully. Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [req-f2085282-ff58-493e-a6e6-d17c2f4b5e1a req-0186b02b-c252-4ee1-a61c-5d6014aa8f10 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:57 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Volume volume-cabd2a42-6365-4ea3-a03a-ccb3aa19f181 (cabd2a42-6365-4ea3-a03a-ccb3aa19f181): created successfully Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc63d45a-e068-45ec-b19a-e611fe4c7621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Flow 'volume_create_manager' (f3d3ad5a-23d8-40c5-9492-d2273e023878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ded88d36-cc52-48f7-a0a8-178fefd45ba8 tempest-CreateVolumesFromImageTest-524251073 None] Lock "cinder-eeec5ddc-c93b-433f-9d34-e2dcb18248bc-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:23:57 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-5d164a07-2415-4028-b251-e9dd6b4c2613 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Created volume successfully. Jul 22 12:23:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-f2085282-ff58-493e-a6e6-d17c2f4b5e1a req-0186b02b-c252-4ee1-a61c-5d6014aa8f10 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29', 'name': 'volume-b21c82f0-42b0-4917-8b05-43a6ce326d64', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b4e0072-c977-4e78-8442-dbc66c441aa2', 'enforce_multipath': True} {{(pid=87568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 12:23:57 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2611bc6c-2604-4465-a7b4-a50b2752b46d Jul 22 12:23:57 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:57 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-f2085282-ff58-493e-a6e6-d17c2f4b5e1a req-0186b02b-c252-4ee1-a61c-5d6014aa8f10 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] attachment_update completed successfully. Jul 22 12:23:58 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0fc412b4-f143-4036-9561-b7eb9448aa1f tempest-CreateVolumesFromImageTest-524251073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2611bc6c-2604-4465-a7b4-a50b2752b46d" returned: 0 in 0.394s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0fc412b4-f143-4036-9561-b7eb9448aa1f tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2611bc6c-2604-4465-a7b4-a50b2752b46d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:58 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2611bc6c-2604-4465-a7b4-a50b2752b46d Jul 22 12:23:58 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:58 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0fc412b4-f143-4036-9561-b7eb9448aa1f tempest-CreateVolumesFromImageTest-524251073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2611bc6c-2604-4465-a7b4-a50b2752b46d" returned: 0 in 0.267s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0fc412b4-f143-4036-9561-b7eb9448aa1f tempest-CreateVolumesFromImageTest-524251073 None] Lock "cinder-quobyte-2611bc6c-2604-4465-a7b4-a50b2752b46d" released by "delete_volume" :: held 0.721s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:23:58 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-0fc412b4-f143-4036-9561-b7eb9448aa1f tempest-CreateVolumesFromImageTest-524251073 None] Created reservations ['64d1aa92-08a3-4c9e-bd32-b9441d946d0c', '99be8e2d-d244-4cd6-82c1-52470d824353', '65fd0199-aa11-415e-a365-02f6cf2e80a1', '8e865994-1f3c-4f23-8db7-4e77e4d31b20'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:23:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0fc412b4-f143-4036-9561-b7eb9448aa1f tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0fc412b4-f143-4036-9561-b7eb9448aa1f tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0fc412b4-f143-4036-9561-b7eb9448aa1f tempest-CreateVolumesFromImageTest-524251073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:23:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0fc412b4-f143-4036-9561-b7eb9448aa1f tempest-CreateVolumesFromImageTest-524251073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:23:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0fc412b4-f143-4036-9561-b7eb9448aa1f tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0fc412b4-f143-4036-9561-b7eb9448aa1f tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:58 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:23:58 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:58 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0fc412b4-f143-4036-9561-b7eb9448aa1f tempest-CreateVolumesFromImageTest-524251073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.268s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:58 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0fc412b4-f143-4036-9561-b7eb9448aa1f tempest-CreateVolumesFromImageTest-524251073 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:23:58 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-0fc412b4-f143-4036-9561-b7eb9448aa1f tempest-CreateVolumesFromImageTest-524251073 None] Deleted volume successfully. Jul 22 12:23:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-fe30b813-ef5f-4dbe-9a05-4c406332ac67 tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "cinder-34f9fc09-ff09-495b-ade4-2263d6512fc3-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:23:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0fc412b4-f143-4036-9561-b7eb9448aa1f tempest-CreateVolumesFromImageTest-524251073 None] Lock "cinder-2611bc6c-2604-4465-a7b4-a50b2752b46d-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:23:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-fe30b813-ef5f-4dbe-9a05-4c406332ac67 tempest-CreateVolumesFromImageTest-524251073 None] Lock "cinder-34f9fc09-ff09-495b-ade4-2263d6512fc3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:23:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-fe30b813-ef5f-4dbe-9a05-4c406332ac67 tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "cinder-quobyte-34f9fc09-ff09-495b-ade4-2263d6512fc3" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:23:58 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-fe30b813-ef5f-4dbe-9a05-4c406332ac67 tempest-CreateVolumesFromImageTest-524251073 None] Lock "cinder-quobyte-34f9fc09-ff09-495b-ade4-2263d6512fc3" acquired by "delete_volume" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7b5a37-9eb6-4020-bfef-006168ca8c5a]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fe30b813-ef5f-4dbe-9a05-4c406332ac67 tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-34f9fc09-ff09-495b-ade4-2263d6512fc3 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:59 devstack sudo[103647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-34f9fc09-ff09-495b-ade4-2263d6512fc3 Jul 22 12:23:59 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Flow 'volume_create_manager' (deaac57d-05f9-458c-b80d-b8370933d3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163277fe-b885-402a-af6f-fa274d06074d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:59 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fe30b813-ef5f-4dbe-9a05-4c406332ac67 tempest-CreateVolumesFromImageTest-524251073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-34f9fc09-ff09-495b-ade4-2263d6512fc3" returned: 0 in 0.443s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fe30b813-ef5f-4dbe-9a05-4c406332ac67 tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-34f9fc09-ff09-495b-ade4-2263d6512fc3 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163277fe-b885-402a-af6f-fa274d06074d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-880128217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa96d33-282c-4e8a-9011-6883db2260f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe0296f94e2461895730f9c8a0de7c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:23:59Z,use_quota=True,user_id='717e05d7e52c43669cceffe087ef013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:59 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-34f9fc09-ff09-495b-ade4-2263d6512fc3 Jul 22 12:23:59 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0f0178-5757-4e3c-8175-8ee8b0edb3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0f0178-5757-4e3c-8175-8ee8b0edb3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67aa5153-4cbe-47a5-8f2a-06a817e6d5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67aa5153-4cbe-47a5-8f2a-06a817e6d5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa96d33-282c-4e8a-9011-6883db2260f8', 'volume_name': 'volume-6fa96d33-282c-4e8a-9011-6883db2260f8', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b30ead-9428-4109-9cb2-c96acfc69cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b30ead-9428-4109-9cb2-c96acfc69cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ed879f-b31f-4d45-80ab-d461826aeffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:59 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Volume 6fa96d33-282c-4e8a-9011-6883db2260f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa96d33-282c-4e8a-9011-6883db2260f8', 'volume_size': 1} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-880128217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa96d33-282c-4e8a-9011-6883db2260f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe0296f94e2461895730f9c8a0de7c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:23:59Z,use_quota=True,user_id='717e05d7e52c43669cceffe087ef013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Creating volume 6fa96d33-282c-4e8a-9011-6883db2260f8 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:23:59 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6fa96d33-282c-4e8a-9011-6883db2260f8 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:23:59 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6fa96d33-282c-4e8a-9011-6883db2260f8 1073741824 Jul 22 12:23:59 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:23:59 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fe30b813-ef5f-4dbe-9a05-4c406332ac67 tempest-CreateVolumesFromImageTest-524251073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-34f9fc09-ff09-495b-ade4-2263d6512fc3" returned: 0 in 0.349s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-fe30b813-ef5f-4dbe-9a05-4c406332ac67 tempest-CreateVolumesFromImageTest-524251073 None] Lock "cinder-quobyte-34f9fc09-ff09-495b-ade4-2263d6512fc3" released by "delete_volume" :: held 0.854s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Flow 'volume_create_manager' (25ae1757-83f3-44de-b7f4-f4659e5e5dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f6b408-bfea-4099-906b-aadb3d4fd87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f6b408-bfea-4099-906b-aadb3d4fd87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1919285850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18c23c8c-4bed-40ac-a705-3de7d5c9b0fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe0296f94e2461895730f9c8a0de7c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:00Z,use_quota=True,user_id='717e05d7e52c43669cceffe087ef013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f44ad04-bdac-464b-a47a-d902497a2597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f44ad04-bdac-464b-a47a-d902497a2597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8dbe61-276f-46c1-a165-4f3bd9bb6ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8dbe61-276f-46c1-a165-4f3bd9bb6ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18c23c8c-4bed-40ac-a705-3de7d5c9b0fd', 'volume_name': 'volume-18c23c8c-4bed-40ac-a705-3de7d5c9b0fd', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:23:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac6fc9c-5fb5-4af6-9b33-62cce162b32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac6fc9c-5fb5-4af6-9b33-62cce162b32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c703f4-5fde-48fb-991c-f1f5a5807d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:00 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Volume 18c23c8c-4bed-40ac-a705-3de7d5c9b0fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18c23c8c-4bed-40ac-a705-3de7d5c9b0fd', 'volume_size': 1} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-fe30b813-ef5f-4dbe-9a05-4c406332ac67 tempest-CreateVolumesFromImageTest-524251073 None] Created reservations ['bd97c928-4646-4bc6-b924-e46ae4e61a6a', '8c49261d-968d-4226-a58d-d1efc84238a2', '5bb143b0-c481-4985-aa7f-ced68ed2ba46', '677a4fda-1663-4625-8106-e26ebfc9e059'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fe30b813-ef5f-4dbe-9a05-4c406332ac67 tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fe30b813-ef5f-4dbe-9a05-4c406332ac67 tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-fe30b813-ef5f-4dbe-9a05-4c406332ac67 tempest-CreateVolumesFromImageTest-524251073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-fe30b813-ef5f-4dbe-9a05-4c406332ac67 tempest-CreateVolumesFromImageTest-524251073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fe30b813-ef5f-4dbe-9a05-4c406332ac67 tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fe30b813-ef5f-4dbe-9a05-4c406332ac67 tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:00 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:24:00 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:00 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6fa96d33-282c-4e8a-9011-6883db2260f8 1073741824" returned: 0 in 0.692s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6fa96d33-282c-4e8a-9011-6883db2260f8 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:00 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6fa96d33-282c-4e8a-9011-6883db2260f8 Jul 22 12:24:00 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Flow 'volume_create_manager' (5ae43a4a-8508-47fa-b6b8-3be35ae09a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (378c5a4a-a582-4ce3-b2d9-a27565853d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (378c5a4a-a582-4ce3-b2d9-a27565853d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-412389239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f3ca569-426a-4724-b39d-0448b513be90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe0296f94e2461895730f9c8a0de7c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:00Z,use_quota=True,user_id='717e05d7e52c43669cceffe087ef013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff13534-5d8e-4ccf-af46-79b1f6d49bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff13534-5d8e-4ccf-af46-79b1f6d49bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce025292-1924-4a67-8dbb-aec28d739eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce025292-1924-4a67-8dbb-aec28d739eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f3ca569-426a-4724-b39d-0448b513be90', 'volume_name': 'volume-9f3ca569-426a-4724-b39d-0448b513be90', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebbcb01-5935-4e8b-ade9-8844f851b590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebbcb01-5935-4e8b-ade9-8844f851b590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1bc2475-6687-46cc-a440-a1ce92e859a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:00 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Volume 9f3ca569-426a-4724-b39d-0448b513be90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f3ca569-426a-4724-b39d-0448b513be90', 'volume_size': 1} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:00 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fe30b813-ef5f-4dbe-9a05-4c406332ac67 tempest-CreateVolumesFromImageTest-524251073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.414s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-fe30b813-ef5f-4dbe-9a05-4c406332ac67 tempest-CreateVolumesFromImageTest-524251073 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:24:00 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-fe30b813-ef5f-4dbe-9a05-4c406332ac67 tempest-CreateVolumesFromImageTest-524251073 None] Deleted volume successfully. Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-fe30b813-ef5f-4dbe-9a05-4c406332ac67 tempest-CreateVolumesFromImageTest-524251073 None] Lock "cinder-34f9fc09-ff09-495b-ade4-2263d6512fc3-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:00 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6fa96d33-282c-4e8a-9011-6883db2260f8" returned: 0 in 0.426s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.763s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1919285850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18c23c8c-4bed-40ac-a705-3de7d5c9b0fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe0296f94e2461895730f9c8a0de7c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:00Z,use_quota=True,user_id='717e05d7e52c43669cceffe087ef013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Creating volume 18c23c8c-4bed-40ac-a705-3de7d5c9b0fd {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:24:00 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-18c23c8c-4bed-40ac-a705-3de7d5c9b0fd 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:00 devstack sudo[103693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-18c23c8c-4bed-40ac-a705-3de7d5c9b0fd 1073741824 Jul 22 12:24:00 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ed879f-b31f-4d45-80ab-d461826aeffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa96d33-282c-4e8a-9011-6883db2260f8', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63961cef-7acf-4eea-bd94-34a2fcd69f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:00 devstack cinder-volume[87568]: INFO cinder.volume.manager [req-2b7a2c8c-30c5-4c60-bdc6-68d9471459a8 req-820498f3-b22f-4bf8-99e4-0cf0438204f4 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Terminate volume connection completed successfully. Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [req-2b7a2c8c-30c5-4c60-bdc6-68d9471459a8 req-820498f3-b22f-4bf8-99e4-0cf0438204f4 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Deleting attachment 6b4e0072-c977-4e78-8442-dbc66c441aa2. {{(pid=87568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 12:24:00 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Volume volume-6fa96d33-282c-4e8a-9011-6883db2260f8 (6fa96d33-282c-4e8a-9011-6883db2260f8): created successfully Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63961cef-7acf-4eea-bd94-34a2fcd69f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Flow 'volume_create_manager' (deaac57d-05f9-458c-b80d-b8370933d3a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:00 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-2990aad5-8d0d-49f9-8106-a6ebca3b460a tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Created volume successfully. Jul 22 12:24:00 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Flow 'volume_create_manager' (999015fd-33ec-49aa-af00-c2824c04ccfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca7b317c-6dcf-4d9e-a21d-54ab48ab7bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca7b317c-6dcf-4d9e-a21d-54ab48ab7bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-854406812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f73b3b2e-1cb8-4fee-b92a-43d055b80c5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe0296f94e2461895730f9c8a0de7c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:01Z,use_quota=True,user_id='717e05d7e52c43669cceffe087ef013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (befceb98-e809-440e-8dd8-bd0c8cc070ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (befceb98-e809-440e-8dd8-bd0c8cc070ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf51021f-1981-49e3-94f4-1fa1a3b41d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf51021f-1981-49e3-94f4-1fa1a3b41d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f73b3b2e-1cb8-4fee-b92a-43d055b80c5c', 'volume_name': 'volume-f73b3b2e-1cb8-4fee-b92a-43d055b80c5c', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ff64ad-8d94-4841-a3b5-626029d582df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ff64ad-8d94-4841-a3b5-626029d582df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ada4a7-ca76-4fa4-96be-c3b10a291b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:01 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Volume f73b3b2e-1cb8-4fee-b92a-43d055b80c5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f73b3b2e-1cb8-4fee-b92a-43d055b80c5c', 'volume_size': 1} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-67d229ad-c9f5-473e-85fa-8e0fff782916 tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "cinder-38aa3436-20e5-4b2a-8faa-6ce688563bd0-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-67d229ad-c9f5-473e-85fa-8e0fff782916 tempest-CreateVolumesFromImageTest-524251073 None] Lock "cinder-38aa3436-20e5-4b2a-8faa-6ce688563bd0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-67d229ad-c9f5-473e-85fa-8e0fff782916 tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "cinder-quobyte-38aa3436-20e5-4b2a-8faa-6ce688563bd0" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-67d229ad-c9f5-473e-85fa-8e0fff782916 tempest-CreateVolumesFromImageTest-524251073 None] Lock "cinder-quobyte-38aa3436-20e5-4b2a-8faa-6ce688563bd0" acquired by "delete_volume" :: waited 0.016s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[341e0f0b-3528-4415-8f63-83aae53dd1eb]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-67d229ad-c9f5-473e-85fa-8e0fff782916 tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-38aa3436-20e5-4b2a-8faa-6ce688563bd0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=102,cinder:UPDATE=115,cinder:INSERT=32,cinder:DELETE=9 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:24:01 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-18c23c8c-4bed-40ac-a705-3de7d5c9b0fd 1073741824" returned: 0 in 0.629s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Flow 'volume_create_manager' (66db9133-42a5-468b-8ee6-f937c5300321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a588a5b3-df25-427b-b3d2-de7df2393261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a588a5b3-df25-427b-b3d2-de7df2393261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-976469704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58aab4a2-3c1d-4a6b-9088-0a63bf7f654f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe0296f94e2461895730f9c8a0de7c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:01Z,use_quota=True,user_id='717e05d7e52c43669cceffe087ef013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c683c4-2dc4-41d7-8cc1-32aaf9c0ce27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c683c4-2dc4-41d7-8cc1-32aaf9c0ce27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b099da2-1de5-41f8-9fa4-947336d1ac5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b099da2-1de5-41f8-9fa4-947336d1ac5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58aab4a2-3c1d-4a6b-9088-0a63bf7f654f', 'volume_name': 'volume-58aab4a2-3c1d-4a6b-9088-0a63bf7f654f', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af25ac8d-6c3c-460b-9a3c-7b5c2ae64d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af25ac8d-6c3c-460b-9a3c-7b5c2ae64d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:01 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-38aa3436-20e5-4b2a-8faa-6ce688563bd0 Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b48c592a-a934-4186-bdca-bd5909fc8f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:01 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Volume 58aab4a2-3c1d-4a6b-9088-0a63bf7f654f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58aab4a2-3c1d-4a6b-9088-0a63bf7f654f', 'volume_size': 1} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:01 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-18c23c8c-4bed-40ac-a705-3de7d5c9b0fd {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:01 devstack sudo[103702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-18c23c8c-4bed-40ac-a705-3de7d5c9b0fd Jul 22 12:24:01 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4295752d-f3df-4f04-98f5-8d0c0d1574d3 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Acquiring lock "cinder-b21c82f0-42b0-4917-8b05-43a6ce326d64-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4295752d-f3df-4f04-98f5-8d0c0d1574d3 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Lock "cinder-b21c82f0-42b0-4917-8b05-43a6ce326d64-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4295752d-f3df-4f04-98f5-8d0c0d1574d3 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Acquiring lock "cinder-quobyte-b21c82f0-42b0-4917-8b05-43a6ce326d64" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4295752d-f3df-4f04-98f5-8d0c0d1574d3 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Lock "cinder-quobyte-b21c82f0-42b0-4917-8b05-43a6ce326d64" acquired by "delete_volume" :: waited 0.021s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[470eac63-d8af-43d4-be22-e29a714e6e59]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4295752d-f3df-4f04-98f5-8d0c0d1574d3 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b21c82f0-42b0-4917-8b05-43a6ce326d64 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:01 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-67d229ad-c9f5-473e-85fa-8e0fff782916 tempest-CreateVolumesFromImageTest-524251073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-38aa3436-20e5-4b2a-8faa-6ce688563bd0" returned: 0 in 0.459s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-67d229ad-c9f5-473e-85fa-8e0fff782916 tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-38aa3436-20e5-4b2a-8faa-6ce688563bd0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:01 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-38aa3436-20e5-4b2a-8faa-6ce688563bd0 Jul 22 12:24:01 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:01 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-18c23c8c-4bed-40ac-a705-3de7d5c9b0fd" returned: 0 in 0.308s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.322s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-412389239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f3ca569-426a-4724-b39d-0448b513be90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe0296f94e2461895730f9c8a0de7c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:00Z,use_quota=True,user_id='717e05d7e52c43669cceffe087ef013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Creating volume 9f3ca569-426a-4724-b39d-0448b513be90 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:24:01 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9f3ca569-426a-4724-b39d-0448b513be90 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=121,cinder:UPDATE=118,cinder:INSERT=28,cinder:DELETE=9 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:24:01 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b21c82f0-42b0-4917-8b05-43a6ce326d64 Jul 22 12:24:01 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c703f4-5fde-48fb-991c-f1f5a5807d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18c23c8c-4bed-40ac-a705-3de7d5c9b0fd', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8872b87-6a48-4503-a316-2180c02525ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:01 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9f3ca569-426a-4724-b39d-0448b513be90 1073741824 Jul 22 12:24:01 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:01 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Volume volume-18c23c8c-4bed-40ac-a705-3de7d5c9b0fd (18c23c8c-4bed-40ac-a705-3de7d5c9b0fd): created successfully Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8872b87-6a48-4503-a316-2180c02525ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Flow 'volume_create_manager' (25ae1757-83f3-44de-b7f4-f4659e5e5dec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:01 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-faec07b3-b937-4912-be18-57fcaa2437c4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Created volume successfully. Jul 22 12:24:02 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-67d229ad-c9f5-473e-85fa-8e0fff782916 tempest-CreateVolumesFromImageTest-524251073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-38aa3436-20e5-4b2a-8faa-6ce688563bd0" returned: 0 in 0.301s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-67d229ad-c9f5-473e-85fa-8e0fff782916 tempest-CreateVolumesFromImageTest-524251073 None] Lock "cinder-quobyte-38aa3436-20e5-4b2a-8faa-6ce688563bd0" released by "delete_volume" :: held 0.834s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-67d229ad-c9f5-473e-85fa-8e0fff782916 tempest-CreateVolumesFromImageTest-524251073 None] Created reservations ['1247e4fd-a1ee-4c31-bbc5-4e18051a207b', 'a54838c6-e386-40d4-9b02-caad8d845e28', 'bc299157-15ec-4f1a-b361-24b8c7b6ab7f', 'a9cca210-228f-432c-bc7c-e2f8133c92a1'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:24:02 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4295752d-f3df-4f04-98f5-8d0c0d1574d3 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b21c82f0-42b0-4917-8b05-43a6ce326d64" returned: 0 in 0.422s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4295752d-f3df-4f04-98f5-8d0c0d1574d3 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b21c82f0-42b0-4917-8b05-43a6ce326d64 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:02 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b21c82f0-42b0-4917-8b05-43a6ce326d64 Jul 22 12:24:02 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-67d229ad-c9f5-473e-85fa-8e0fff782916 tempest-CreateVolumesFromImageTest-524251073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-67d229ad-c9f5-473e-85fa-8e0fff782916 tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-67d229ad-c9f5-473e-85fa-8e0fff782916 tempest-CreateVolumesFromImageTest-524251073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-67d229ad-c9f5-473e-85fa-8e0fff782916 tempest-CreateVolumesFromImageTest-524251073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-67d229ad-c9f5-473e-85fa-8e0fff782916 tempest-CreateVolumesFromImageTest-524251073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-67d229ad-c9f5-473e-85fa-8e0fff782916 tempest-CreateVolumesFromImageTest-524251073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:02 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:24:02 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:02 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9f3ca569-426a-4724-b39d-0448b513be90 1073741824" returned: 0 in 0.500s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9f3ca569-426a-4724-b39d-0448b513be90 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:02 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9f3ca569-426a-4724-b39d-0448b513be90 Jul 22 12:24:02 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:02 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4295752d-f3df-4f04-98f5-8d0c0d1574d3 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b21c82f0-42b0-4917-8b05-43a6ce326d64" returned: 0 in 0.325s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4295752d-f3df-4f04-98f5-8d0c0d1574d3 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Lock "cinder-quobyte-b21c82f0-42b0-4917-8b05-43a6ce326d64" released by "delete_volume" :: held 0.792s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:02 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-67d229ad-c9f5-473e-85fa-8e0fff782916 tempest-CreateVolumesFromImageTest-524251073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.322s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-67d229ad-c9f5-473e-85fa-8e0fff782916 tempest-CreateVolumesFromImageTest-524251073 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:24:02 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-67d229ad-c9f5-473e-85fa-8e0fff782916 tempest-CreateVolumesFromImageTest-524251073 None] Deleted volume successfully. Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-4295752d-f3df-4f04-98f5-8d0c0d1574d3 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Created reservations ['e2cbb003-14ef-432c-b713-28dae7833200', '248b314c-9d94-45fd-bf82-8913f3fc91d7', '430e6235-3121-46bf-8251-56e144ed52c4', 'a8e4d5fd-9600-4e2a-abb3-f8b9724cbd9c'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-67d229ad-c9f5-473e-85fa-8e0fff782916 tempest-CreateVolumesFromImageTest-524251073 None] Lock "cinder-38aa3436-20e5-4b2a-8faa-6ce688563bd0-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4295752d-f3df-4f04-98f5-8d0c0d1574d3 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4295752d-f3df-4f04-98f5-8d0c0d1574d3 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4295752d-f3df-4f04-98f5-8d0c0d1574d3 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4295752d-f3df-4f04-98f5-8d0c0d1574d3 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4295752d-f3df-4f04-98f5-8d0c0d1574d3 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4295752d-f3df-4f04-98f5-8d0c0d1574d3 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:02 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:24:02 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:02 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9f3ca569-426a-4724-b39d-0448b513be90" returned: 0 in 0.309s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.639s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-854406812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f73b3b2e-1cb8-4fee-b92a-43d055b80c5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe0296f94e2461895730f9c8a0de7c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:01Z,use_quota=True,user_id='717e05d7e52c43669cceffe087ef013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Creating volume f73b3b2e-1cb8-4fee-b92a-43d055b80c5c {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:24:02 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f73b3b2e-1cb8-4fee-b92a-43d055b80c5c 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1bc2475-6687-46cc-a440-a1ce92e859a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f3ca569-426a-4724-b39d-0448b513be90', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d10b70ba-c0c6-471d-9368-d37e6070149b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:02 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f73b3b2e-1cb8-4fee-b92a-43d055b80c5c 1073741824 Jul 22 12:24:02 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:02 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Volume volume-9f3ca569-426a-4724-b39d-0448b513be90 (9f3ca569-426a-4724-b39d-0448b513be90): created successfully Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d10b70ba-c0c6-471d-9368-d37e6070149b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Flow 'volume_create_manager' (5ae43a4a-8508-47fa-b6b8-3be35ae09a9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:02 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e759b830-d568-4ae8-8ecd-f21d86980725 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Created volume successfully. Jul 22 12:24:03 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4295752d-f3df-4f04-98f5-8d0c0d1574d3 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.370s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:03 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-4295752d-f3df-4f04-98f5-8d0c0d1574d3 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:24:03 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-4295752d-f3df-4f04-98f5-8d0c0d1574d3 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Deleted volume successfully. Jul 22 12:24:03 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4295752d-f3df-4f04-98f5-8d0c0d1574d3 tempest-TestServerVolumeAttachScenarioOldVersion-931098008 None] Lock "cinder-b21c82f0-42b0-4917-8b05-43a6ce326d64-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:03 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f73b3b2e-1cb8-4fee-b92a-43d055b80c5c 1073741824" returned: 0 in 0.618s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f73b3b2e-1cb8-4fee-b92a-43d055b80c5c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:03 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f73b3b2e-1cb8-4fee-b92a-43d055b80c5c Jul 22 12:24:03 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:03 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f73b3b2e-1cb8-4fee-b92a-43d055b80c5c" returned: 0 in 0.434s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:03 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:24:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.387s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:03 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-976469704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58aab4a2-3c1d-4a6b-9088-0a63bf7f654f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe0296f94e2461895730f9c8a0de7c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:01Z,use_quota=True,user_id='717e05d7e52c43669cceffe087ef013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:24:03 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Creating volume 58aab4a2-3c1d-4a6b-9088-0a63bf7f654f {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:24:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:03 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:03 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:03 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:24:03 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:24:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58aab4a2-3c1d-4a6b-9088-0a63bf7f654f 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ada4a7-ca76-4fa4-96be-c3b10a291b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f73b3b2e-1cb8-4fee-b92a-43d055b80c5c', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:03 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58aab4a2-3c1d-4a6b-9088-0a63bf7f654f 1073741824 Jul 22 12:24:03 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:04 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a86f14-c382-4c57-a5bc-989fb4913d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:04 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Volume volume-f73b3b2e-1cb8-4fee-b92a-43d055b80c5c (f73b3b2e-1cb8-4fee-b92a-43d055b80c5c): created successfully Jul 22 12:24:04 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a86f14-c382-4c57-a5bc-989fb4913d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:04 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Flow 'volume_create_manager' (999015fd-33ec-49aa-af00-c2824c04ccfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:04 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b1c12563-b33c-4d72-b8a4-710ae41ac588 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Created volume successfully. Jul 22 12:24:04 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58aab4a2-3c1d-4a6b-9088-0a63bf7f654f 1073741824" returned: 0 in 0.619s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58aab4a2-3c1d-4a6b-9088-0a63bf7f654f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:04 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58aab4a2-3c1d-4a6b-9088-0a63bf7f654f Jul 22 12:24:04 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:05 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58aab4a2-3c1d-4a6b-9088-0a63bf7f654f" returned: 0 in 0.475s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:05 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:24:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:05 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b48c592a-a934-4186-bdca-bd5909fc8f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58aab4a2-3c1d-4a6b-9088-0a63bf7f654f', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:05 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c1cffd-92c0-4527-a7a5-02976ddd48f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:05 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Volume volume-58aab4a2-3c1d-4a6b-9088-0a63bf7f654f (58aab4a2-3c1d-4a6b-9088-0a63bf7f654f): created successfully Jul 22 12:24:05 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c1cffd-92c0-4527-a7a5-02976ddd48f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:05 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Flow 'volume_create_manager' (66db9133-42a5-468b-8ee6-f937c5300321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:05 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-cbbaa65e-183b-45b3-bf08-7b427847133e tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Created volume successfully. Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b4f58c6e-abe2-4ec6-96f1-791d7a8e10ed tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "cinder-58aab4a2-3c1d-4a6b-9088-0a63bf7f654f-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b4f58c6e-abe2-4ec6-96f1-791d7a8e10ed tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-58aab4a2-3c1d-4a6b-9088-0a63bf7f654f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b4f58c6e-abe2-4ec6-96f1-791d7a8e10ed tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "cinder-quobyte-58aab4a2-3c1d-4a6b-9088-0a63bf7f654f" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b4f58c6e-abe2-4ec6-96f1-791d7a8e10ed tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-quobyte-58aab4a2-3c1d-4a6b-9088-0a63bf7f654f" acquired by "delete_volume" :: waited 0.030s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d629314b-6af2-4a77-83d2-d6c5fe5d07be]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b4f58c6e-abe2-4ec6-96f1-791d7a8e10ed tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58aab4a2-3c1d-4a6b-9088-0a63bf7f654f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:06 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58aab4a2-3c1d-4a6b-9088-0a63bf7f654f Jul 22 12:24:06 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:06 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b4f58c6e-abe2-4ec6-96f1-791d7a8e10ed tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58aab4a2-3c1d-4a6b-9088-0a63bf7f654f" returned: 0 in 0.455s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b4f58c6e-abe2-4ec6-96f1-791d7a8e10ed tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58aab4a2-3c1d-4a6b-9088-0a63bf7f654f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:24:06 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58aab4a2-3c1d-4a6b-9088-0a63bf7f654f Jul 22 12:24:06 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Flow 'volume_create_manager' (d0ac8ffe-8833-4098-b1af-88375aecfd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab8cdbb-ea59-4b0c-af10-9af9e0f8fe94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab8cdbb-ea59-4b0c-af10-9af9e0f8fe94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2081689936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0ab87d-9e0d-478d-a5b7-85a4069772ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45d05bd660e4a07ac5e3294c4105ba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:07Z,use_quota=True,user_id='75ff9f3d206245148df6f6c69c23135a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0894bf4-d9f0-48fb-8c3e-6466d22ba4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0894bf4-d9f0-48fb-8c3e-6466d22ba4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ecd383e-59a3-4b7c-ac2e-8f1a350997a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ecd383e-59a3-4b7c-ac2e-8f1a350997a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df0ab87d-9e0d-478d-a5b7-85a4069772ba', 'volume_name': 'volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ac212d-481e-49a6-bd64-dcdf5e9b3528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ac212d-481e-49a6-bd64-dcdf5e9b3528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e33a9a2-304a-4a0a-8f90-a88fc5e64236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:06 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Volume df0ab87d-9e0d-478d-a5b7-85a4069772ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba', 'volume_size': 1} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2081689936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0ab87d-9e0d-478d-a5b7-85a4069772ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45d05bd660e4a07ac5e3294c4105ba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:07Z,use_quota=True,user_id='75ff9f3d206245148df6f6c69c23135a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Creating volume df0ab87d-9e0d-478d-a5b7-85a4069772ba {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:24:06 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:24:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:06 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba 1073741824 Jul 22 12:24:06 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:07 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b4f58c6e-abe2-4ec6-96f1-791d7a8e10ed tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-58aab4a2-3c1d-4a6b-9088-0a63bf7f654f" returned: 0 in 0.274s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b4f58c6e-abe2-4ec6-96f1-791d7a8e10ed tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-quobyte-58aab4a2-3c1d-4a6b-9088-0a63bf7f654f" released by "delete_volume" :: held 0.794s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-b4f58c6e-abe2-4ec6-96f1-791d7a8e10ed tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Created reservations ['7a180d3a-fa2a-4163-94c4-522fd67342d7', '27a5627c-df0e-494c-9019-becd59c2a20d', '541e897a-52a5-42f2-836a-3394a945cc1b', 'b603d2b4-5d72-495e-8ce8-7d214eb7f2bd'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b4f58c6e-abe2-4ec6-96f1-791d7a8e10ed tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b4f58c6e-abe2-4ec6-96f1-791d7a8e10ed tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b4f58c6e-abe2-4ec6-96f1-791d7a8e10ed tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b4f58c6e-abe2-4ec6-96f1-791d7a8e10ed tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b4f58c6e-abe2-4ec6-96f1-791d7a8e10ed tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b4f58c6e-abe2-4ec6-96f1-791d7a8e10ed tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:07 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:24:07 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1ba82734-d49c-4428-8e83-a95b9c855db2 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "cinder-f73b3b2e-1cb8-4fee-b92a-43d055b80c5c-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1ba82734-d49c-4428-8e83-a95b9c855db2 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-f73b3b2e-1cb8-4fee-b92a-43d055b80c5c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:07 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba 1073741824" returned: 0 in 0.588s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1ba82734-d49c-4428-8e83-a95b9c855db2 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "cinder-quobyte-f73b3b2e-1cb8-4fee-b92a-43d055b80c5c" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1ba82734-d49c-4428-8e83-a95b9c855db2 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-quobyte-f73b3b2e-1cb8-4fee-b92a-43d055b80c5c" acquired by "delete_volume" :: waited 0.031s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1fea26-90d0-4433-a528-31a6fafc8e6f]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1ba82734-d49c-4428-8e83-a95b9c855db2 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f73b3b2e-1cb8-4fee-b92a-43d055b80c5c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:07 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b4f58c6e-abe2-4ec6-96f1-791d7a8e10ed tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.377s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-b4f58c6e-abe2-4ec6-96f1-791d7a8e10ed tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:24:07 devstack sudo[103794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba Jul 22 12:24:07 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:07 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b4f58c6e-abe2-4ec6-96f1-791d7a8e10ed tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Deleted volume successfully. Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b4f58c6e-abe2-4ec6-96f1-791d7a8e10ed tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-58aab4a2-3c1d-4a6b-9088-0a63bf7f654f-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:07 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f73b3b2e-1cb8-4fee-b92a-43d055b80c5c Jul 22 12:24:07 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:07 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba" returned: 0 in 0.316s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e33a9a2-304a-4a0a-8f90-a88fc5e64236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd8136c-f79d-43df-962b-7a899ee82134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:07 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Volume volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba (df0ab87d-9e0d-478d-a5b7-85a4069772ba): created successfully Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd8136c-f79d-43df-962b-7a899ee82134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Flow 'volume_create_manager' (d0ac8ffe-8833-4098-b1af-88375aecfd5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:08 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b57ad1d8-ee4a-4a1a-84fd-7537f4776448 tempest-VolumeDependencyTests-914992643 None] Created volume successfully. Jul 22 12:24:08 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1ba82734-d49c-4428-8e83-a95b9c855db2 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f73b3b2e-1cb8-4fee-b92a-43d055b80c5c" returned: 0 in 0.453s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1ba82734-d49c-4428-8e83-a95b9c855db2 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f73b3b2e-1cb8-4fee-b92a-43d055b80c5c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:08 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f73b3b2e-1cb8-4fee-b92a-43d055b80c5c Jul 22 12:24:08 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:08 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1ba82734-d49c-4428-8e83-a95b9c855db2 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f73b3b2e-1cb8-4fee-b92a-43d055b80c5c" returned: 0 in 0.246s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:08 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1ba82734-d49c-4428-8e83-a95b9c855db2 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-quobyte-f73b3b2e-1cb8-4fee-b92a-43d055b80c5c" released by "delete_volume" :: held 0.755s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:08 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-1ba82734-d49c-4428-8e83-a95b9c855db2 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Created reservations ['7711c26c-af31-4295-a1e9-9d4bef3ebdd4', '7c40f3e6-b93d-44f5-a7aa-bbce8a3be94b', 'f316ad79-5e10-45c7-b864-b32c2d21f4e0', 'a4900031-525c-4198-9046-9809c01fea28'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:24:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1ba82734-d49c-4428-8e83-a95b9c855db2 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1ba82734-d49c-4428-8e83-a95b9c855db2 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1ba82734-d49c-4428-8e83-a95b9c855db2 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1ba82734-d49c-4428-8e83-a95b9c855db2 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1ba82734-d49c-4428-8e83-a95b9c855db2 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1ba82734-d49c-4428-8e83-a95b9c855db2 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:08 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:24:08 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:08 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-859732d9-7884-4895-aa61-37a3e9c62835 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "cinder-9f3ca569-426a-4724-b39d-0448b513be90-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:08 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-859732d9-7884-4895-aa61-37a3e9c62835 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-9f3ca569-426a-4724-b39d-0448b513be90-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:08 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-859732d9-7884-4895-aa61-37a3e9c62835 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "cinder-quobyte-9f3ca569-426a-4724-b39d-0448b513be90" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:08 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-859732d9-7884-4895-aa61-37a3e9c62835 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-quobyte-9f3ca569-426a-4724-b39d-0448b513be90" acquired by "delete_volume" :: waited 0.016s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:08 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f70b91-0c78-49e9-a902-c1356713dccc]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859732d9-7884-4895-aa61-37a3e9c62835 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9f3ca569-426a-4724-b39d-0448b513be90 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:08 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1ba82734-d49c-4428-8e83-a95b9c855db2 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.331s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:08 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-1ba82734-d49c-4428-8e83-a95b9c855db2 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:24:08 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-1ba82734-d49c-4428-8e83-a95b9c855db2 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Deleted volume successfully. Jul 22 12:24:08 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1ba82734-d49c-4428-8e83-a95b9c855db2 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-f73b3b2e-1cb8-4fee-b92a-43d055b80c5c-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:08 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9f3ca569-426a-4724-b39d-0448b513be90 Jul 22 12:24:08 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-97ac30b5-9ea1-4a21-81f3-dcc0e2e21ad1 tempest-VolumeDependencyTests-914992643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-97ac30b5-9ea1-4a21-81f3-dcc0e2e21ad1 tempest-VolumeDependencyTests-914992643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-97ac30b5-9ea1-4a21-81f3-dcc0e2e21ad1 tempest-VolumeDependencyTests-914992643 None] Creating offline snapshot 9ed9f384-86d1-47ed-8b3f-0d9872efe9dc of volume df0ab87d-9e0d-478d-a5b7-85a4069772ba {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[62523b08-0ff9-4651-851d-2a6480386a3d]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-97ac30b5-9ea1-4a21-81f3-dcc0e2e21ad1 tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:09 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859732d9-7884-4895-aa61-37a3e9c62835 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9f3ca569-426a-4724-b39d-0448b513be90" returned: 0 in 0.495s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859732d9-7884-4895-aa61-37a3e9c62835 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9f3ca569-426a-4724-b39d-0448b513be90 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:09 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9f3ca569-426a-4724-b39d-0448b513be90 Jul 22 12:24:09 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:09 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba Jul 22 12:24:09 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:09 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859732d9-7884-4895-aa61-37a3e9c62835 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9f3ca569-426a-4724-b39d-0448b513be90" returned: 0 in 0.258s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-859732d9-7884-4895-aa61-37a3e9c62835 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-quobyte-9f3ca569-426a-4724-b39d-0448b513be90" released by "delete_volume" :: held 0.798s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-859732d9-7884-4895-aa61-37a3e9c62835 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Created reservations ['1acf1773-53d9-4e4b-9c12-6012e7ee8159', 'd26d87d2-03cf-49af-b3e9-4ced1e94a41f', '2cb06729-92e0-4cb2-bb28-5bf2486a3154', '8020691c-c6f4-4079-b60e-8b631d20e8c7'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:24:09 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-97ac30b5-9ea1-4a21-81f3-dcc0e2e21ad1 tempest-VolumeDependencyTests-914992643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba" returned: 0 in 0.389s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-97ac30b5-9ea1-4a21-81f3-dcc0e2e21ad1 tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:09 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc 1G Jul 22 12:24:09 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-859732d9-7884-4895-aa61-37a3e9c62835 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-859732d9-7884-4895-aa61-37a3e9c62835 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-859732d9-7884-4895-aa61-37a3e9c62835 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-859732d9-7884-4895-aa61-37a3e9c62835 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-859732d9-7884-4895-aa61-37a3e9c62835 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859732d9-7884-4895-aa61-37a3e9c62835 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:09 devstack sudo[103824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:24:09 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f77e2b25-3b78-4dc5-8058-903863f25c39 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "cinder-18c23c8c-4bed-40ac-a705-3de7d5c9b0fd-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f77e2b25-3b78-4dc5-8058-903863f25c39 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-18c23c8c-4bed-40ac-a705-3de7d5c9b0fd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f77e2b25-3b78-4dc5-8058-903863f25c39 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "cinder-quobyte-18c23c8c-4bed-40ac-a705-3de7d5c9b0fd" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f77e2b25-3b78-4dc5-8058-903863f25c39 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-quobyte-18c23c8c-4bed-40ac-a705-3de7d5c9b0fd" acquired by "delete_volume" :: waited 0.029s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f638f7-265e-4444-b223-ae76b241538a]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f77e2b25-3b78-4dc5-8058-903863f25c39 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-18c23c8c-4bed-40ac-a705-3de7d5c9b0fd {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:10 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859732d9-7884-4895-aa61-37a3e9c62835 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.328s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:10 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-859732d9-7884-4895-aa61-37a3e9c62835 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:24:10 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-859732d9-7884-4895-aa61-37a3e9c62835 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Deleted volume successfully. Jul 22 12:24:10 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-859732d9-7884-4895-aa61-37a3e9c62835 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-9f3ca569-426a-4724-b39d-0448b513be90-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:10 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-18c23c8c-4bed-40ac-a705-3de7d5c9b0fd Jul 22 12:24:10 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:10 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-97ac30b5-9ea1-4a21-81f3-dcc0e2e21ad1 tempest-VolumeDependencyTests-914992643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc 1G" returned: 0 in 0.604s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-97ac30b5-9ea1-4a21-81f3-dcc0e2e21ad1 tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:10 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc Jul 22 12:24:10 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:10 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f77e2b25-3b78-4dc5-8058-903863f25c39 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-18c23c8c-4bed-40ac-a705-3de7d5c9b0fd" returned: 0 in 0.522s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f77e2b25-3b78-4dc5-8058-903863f25c39 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-18c23c8c-4bed-40ac-a705-3de7d5c9b0fd {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:10 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-18c23c8c-4bed-40ac-a705-3de7d5c9b0fd Jul 22 12:24:10 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:10 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-97ac30b5-9ea1-4a21-81f3-dcc0e2e21ad1 tempest-VolumeDependencyTests-914992643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc" returned: 0 in 0.389s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:10 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-97ac30b5-9ea1-4a21-81f3-dcc0e2e21ad1 tempest-VolumeDependencyTests-914992643 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc is being set with open permissions: ugo+rw Jul 22 12:24:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-97ac30b5-9ea1-4a21-81f3-dcc0e2e21ad1 tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:10 devstack sudo[103845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc Jul 22 12:24:10 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:10 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f77e2b25-3b78-4dc5-8058-903863f25c39 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-18c23c8c-4bed-40ac-a705-3de7d5c9b0fd" returned: 0 in 0.304s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:10 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f77e2b25-3b78-4dc5-8058-903863f25c39 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-quobyte-18c23c8c-4bed-40ac-a705-3de7d5c9b0fd" released by "delete_volume" :: held 0.886s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:10 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-97ac30b5-9ea1-4a21-81f3-dcc0e2e21ad1 tempest-VolumeDependencyTests-914992643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc" returned: 0 in 0.272s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:10 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-f77e2b25-3b78-4dc5-8058-903863f25c39 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Created reservations ['0f3c574d-214b-4a1e-a128-057f5eb60fcf', 'fa5e306b-b98e-4291-8e5a-689de224ffdf', '35285672-a878-4a87-8a3f-c90c365e3939', '03d3cb3a-a336-459d-b9b3-b69966e00e91'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:24:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-97ac30b5-9ea1-4a21-81f3-dcc0e2e21ad1 tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:10 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.info Jul 22 12:24:10 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f77e2b25-3b78-4dc5-8058-903863f25c39 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f77e2b25-3b78-4dc5-8058-903863f25c39 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f77e2b25-3b78-4dc5-8058-903863f25c39 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f77e2b25-3b78-4dc5-8058-903863f25c39 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f77e2b25-3b78-4dc5-8058-903863f25c39 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f77e2b25-3b78-4dc5-8058-903863f25c39 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:11 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:24:11 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:11 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-545b8b00-5c1e-4869-90a1-941b7fba6fb4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "cinder-6fa96d33-282c-4e8a-9011-6883db2260f8-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:11 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-545b8b00-5c1e-4869-90a1-941b7fba6fb4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-6fa96d33-282c-4e8a-9011-6883db2260f8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:11 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-545b8b00-5c1e-4869-90a1-941b7fba6fb4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "cinder-quobyte-6fa96d33-282c-4e8a-9011-6883db2260f8" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:11 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-545b8b00-5c1e-4869-90a1-941b7fba6fb4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-quobyte-6fa96d33-282c-4e8a-9011-6883db2260f8" acquired by "delete_volume" :: waited 0.022s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:11 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-97ac30b5-9ea1-4a21-81f3-dcc0e2e21ad1 tempest-VolumeDependencyTests-914992643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.info" returned: 0 in 0.366s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:11 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-97ac30b5-9ea1-4a21-81f3-dcc0e2e21ad1 tempest-VolumeDependencyTests-914992643 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.info is being set with open permissions: ugo+rw Jul 22 12:24:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-97ac30b5-9ea1-4a21-81f3-dcc0e2e21ad1 tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:11 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c8dd45-d0c9-4f8c-8b3d-141cd14c0eaa]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-545b8b00-5c1e-4869-90a1-941b7fba6fb4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6fa96d33-282c-4e8a-9011-6883db2260f8 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:11 devstack sudo[103856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.info Jul 22 12:24:11 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:11 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f77e2b25-3b78-4dc5-8058-903863f25c39 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.395s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:11 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-f77e2b25-3b78-4dc5-8058-903863f25c39 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:24:11 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-f77e2b25-3b78-4dc5-8058-903863f25c39 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Deleted volume successfully. Jul 22 12:24:11 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-f77e2b25-3b78-4dc5-8058-903863f25c39 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-18c23c8c-4bed-40ac-a705-3de7d5c9b0fd-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:11 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6fa96d33-282c-4e8a-9011-6883db2260f8 Jul 22 12:24:11 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:11 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-97ac30b5-9ea1-4a21-81f3-dcc0e2e21ad1 tempest-VolumeDependencyTests-914992643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.info" returned: 0 in 0.305s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-97ac30b5-9ea1-4a21-81f3-dcc0e2e21ad1 tempest-VolumeDependencyTests-914992643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.451s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:11 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-97ac30b5-9ea1-4a21-81f3-dcc0e2e21ad1 tempest-VolumeDependencyTests-914992643 None] Create snapshot completed successfully Jul 22 12:24:11 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-545b8b00-5c1e-4869-90a1-941b7fba6fb4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6fa96d33-282c-4e8a-9011-6883db2260f8" returned: 0 in 0.444s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-545b8b00-5c1e-4869-90a1-941b7fba6fb4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6fa96d33-282c-4e8a-9011-6883db2260f8 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:11 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6fa96d33-282c-4e8a-9011-6883db2260f8 Jul 22 12:24:11 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:12 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-545b8b00-5c1e-4869-90a1-941b7fba6fb4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6fa96d33-282c-4e8a-9011-6883db2260f8" returned: 0 in 0.256s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-545b8b00-5c1e-4869-90a1-941b7fba6fb4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-quobyte-6fa96d33-282c-4e8a-9011-6883db2260f8" released by "delete_volume" :: held 0.772s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:12 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-545b8b00-5c1e-4869-90a1-941b7fba6fb4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Created reservations ['4199dfb2-51a1-4cc7-8fa1-1eca75f97fa9', '3120f9f2-fcbf-4013-9a8a-8bb5e5226fe7', '9a412a50-7553-4501-9505-d3eb5a76cb65', '5917432d-1b2c-497f-be06-fe3637bdd805'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:24:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-545b8b00-5c1e-4869-90a1-941b7fba6fb4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-545b8b00-5c1e-4869-90a1-941b7fba6fb4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-545b8b00-5c1e-4869-90a1-941b7fba6fb4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-545b8b00-5c1e-4869-90a1-941b7fba6fb4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-545b8b00-5c1e-4869-90a1-941b7fba6fb4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-545b8b00-5c1e-4869-90a1-941b7fba6fb4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:12 devstack sudo[103868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:24:12 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2f0282dd-490c-406a-b05e-82efb349366c tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "cinder-cabd2a42-6365-4ea3-a03a-ccb3aa19f181-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2f0282dd-490c-406a-b05e-82efb349366c tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-cabd2a42-6365-4ea3-a03a-ccb3aa19f181-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:12 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2f0282dd-490c-406a-b05e-82efb349366c tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "cinder-quobyte-cabd2a42-6365-4ea3-a03a-ccb3aa19f181" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-545b8b00-5c1e-4869-90a1-941b7fba6fb4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.298s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:12 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-545b8b00-5c1e-4869-90a1-941b7fba6fb4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:24:12 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-545b8b00-5c1e-4869-90a1-941b7fba6fb4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Deleted volume successfully. Jul 22 12:24:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2f0282dd-490c-406a-b05e-82efb349366c tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-quobyte-cabd2a42-6365-4ea3-a03a-ccb3aa19f181" acquired by "delete_volume" :: waited 0.027s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-545b8b00-5c1e-4869-90a1-941b7fba6fb4 tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-6fa96d33-282c-4e8a-9011-6883db2260f8-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:12 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbece868-fff8-49db-9912-42298d15ce1c]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2f0282dd-490c-406a-b05e-82efb349366c tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cabd2a42-6365-4ea3-a03a-ccb3aa19f181 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:12 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cabd2a42-6365-4ea3-a03a-ccb3aa19f181 Jul 22 12:24:12 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:12 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2f0282dd-490c-406a-b05e-82efb349366c tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cabd2a42-6365-4ea3-a03a-ccb3aa19f181" returned: 0 in 0.397s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2f0282dd-490c-406a-b05e-82efb349366c tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cabd2a42-6365-4ea3-a03a-ccb3aa19f181 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:12 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cabd2a42-6365-4ea3-a03a-ccb3aa19f181 Jul 22 12:24:12 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Flow 'volume_create_manager' (803f18a3-b471-4dc7-b685-fe266c97ac3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c925c887-f4ed-4cbd-935e-21addaa6b2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c925c887-f4ed-4cbd-935e-21addaa6b2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-753608405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fca0d0a3-9b17-4eab-80a3-48d9f9f34b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45d05bd660e4a07ac5e3294c4105ba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9ed9f384-86d1-47ed-8b3f-0d9872efe9dc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:13Z,use_quota=True,user_id='75ff9f3d206245148df6f6c69c23135a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202d5da0-510f-47bb-ad2f-f558e4adbfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202d5da0-510f-47bb-ad2f-f558e4adbfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c83310-6d64-4f4c-a232-43437e038d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c83310-6d64-4f4c-a232-43437e038d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fca0d0a3-9b17-4eab-80a3-48d9f9f34b79', 'volume_name': 'volume-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79', 'volume_size': 1, 'snapshot_id': '9ed9f384-86d1-47ed-8b3f-0d9872efe9dc'}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3252f5a-6995-4cd9-9546-b4ec65187930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3252f5a-6995-4cd9-9546-b4ec65187930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e8210c1-5e91-489b-8d7e-694186f1f14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:13 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Volume fca0d0a3-9b17-4eab-80a3-48d9f9f34b79: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79', 'volume_size': 1, 'snapshot_id': '9ed9f384-86d1-47ed-8b3f-0d9872efe9dc'} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Acquiring lock "cinder-quobyte-9ed9f384-86d1-47ed-8b3f-0d9872efe9dc-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79" by "_create_volume_from_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Lock "cinder-quobyte-9ed9f384-86d1-47ed-8b3f-0d9872efe9dc-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Creating volume fca0d0a3-9b17-4eab-80a3-48d9f9f34b79 from snapshot 9ed9f384-86d1-47ed-8b3f-0d9872efe9dc {{(pid=87568) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Acquiring lock "cinder-quobyte-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79" by "_copy_volume_from_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Lock "cinder-quobyte-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] snapshot: 9ed9f384-86d1-47ed-8b3f-0d9872efe9dc, volume: fca0d0a3-9b17-4eab-80a3-48d9f9f34b79, {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 12:24:13 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2f0282dd-490c-406a-b05e-82efb349366c tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cabd2a42-6365-4ea3-a03a-ccb3aa19f181" returned: 0 in 0.306s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed036853-c829-42cf-8fed-37c4425d3cc7]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2f0282dd-490c-406a-b05e-82efb349366c tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-quobyte-cabd2a42-6365-4ea3-a03a-ccb3aa19f181" released by "delete_volume" :: held 0.768s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-2f0282dd-490c-406a-b05e-82efb349366c tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Created reservations ['22543d86-4fdc-4a04-952c-56ef536aa908', 'c62e113c-c53a-4258-9159-69af2da035b8', '43f58c3c-f0b0-49ca-bb4b-8b6c3483f618', '7a04da6b-90fd-4c95-9dbd-f39bfe2fb225'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:24:13 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc Jul 22 12:24:13 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2f0282dd-490c-406a-b05e-82efb349366c tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2f0282dd-490c-406a-b05e-82efb349366c tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2f0282dd-490c-406a-b05e-82efb349366c tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2f0282dd-490c-406a-b05e-82efb349366c tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2f0282dd-490c-406a-b05e-82efb349366c tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2f0282dd-490c-406a-b05e-82efb349366c tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:13 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:24:13 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:13 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc" returned: 0 in 0.407s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] will copy from snapshot at /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Creating direct copy from snapshot {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae26129-15f9-4511-b747-e11c3ca70aba]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:13 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2f0282dd-490c-406a-b05e-82efb349366c tempest-CreateVolumesFromSourceVolumeTest-674293694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.317s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-2f0282dd-490c-406a-b05e-82efb349366c tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:24:13 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-2f0282dd-490c-406a-b05e-82efb349366c tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Deleted volume successfully. Jul 22 12:24:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2f0282dd-490c-406a-b05e-82efb349366c tempest-CreateVolumesFromSourceVolumeTest-674293694 None] Lock "cinder-cabd2a42-6365-4ea3-a03a-ccb3aa19f181-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:13 devstack sudo[103888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba Jul 22 12:24:13 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:14 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba" returned: 0 in 0.449s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:14 devstack cinder-volume[87568]: DEBUG cinder.utils [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Path /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79 not found in is_blk_device check {{(pid=87568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 12:24:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:14 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79 Jul 22 12:24:14 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:19 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79" returned: 0 in 5.603s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:19 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a83092-f7b1-48d2-b912-5cc5e6d9e955]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:19 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba Jul 22 12:24:19 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:20 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba" returned: 0 in 0.568s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:20 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Image conversion details: src /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79 {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:24:20 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Converted 1024.00 MB image at 182.71 MB/s Jul 22 12:24:20 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79 is being set with open permissions: ugo+rw Jul 22 12:24:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:20 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79 Jul 22 12:24:20 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:20 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79" returned: 0 in 0.258s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Lock "cinder-quobyte-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79" released by "_copy_volume_from_snapshot" :: held 7.415s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Lock "cinder-quobyte-9ed9f384-86d1-47ed-8b3f-0d9872efe9dc-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79" released by "_create_volume_from_snapshot" :: held 7.453s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.476s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e8210c1-5e91-489b-8d7e-694186f1f14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79', 'volume_size': 1, 'snapshot_id': '9ed9f384-86d1-47ed-8b3f-0d9872efe9dc'}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fad3f72-0d9e-40db-9f21-b87e9f7af93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:20 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Volume volume-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79 (fca0d0a3-9b17-4eab-80a3-48d9f9f34b79): created successfully Jul 22 12:24:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fad3f72-0d9e-40db-9f21-b87e9f7af93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Flow 'volume_create_manager' (803f18a3-b471-4dc7-b685-fe266c97ac3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:20 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-dd283137-f605-42e9-a909-039a434a5c1f tempest-VolumeDependencyTests-914992643 None] Created volume successfully. Jul 22 12:24:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-493bcefb-5016-4d10-a84a-a456e39a76ae tempest-VolumeDependencyTests-914992643 None] Acquiring lock "cinder-9ed9f384-86d1-47ed-8b3f-0d9872efe9dc-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-493bcefb-5016-4d10-a84a-a456e39a76ae tempest-VolumeDependencyTests-914992643 None] Lock "cinder-9ed9f384-86d1-47ed-8b3f-0d9872efe9dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-493bcefb-5016-4d10-a84a-a456e39a76ae tempest-VolumeDependencyTests-914992643 None] Acquiring lock "cinder-quobyte-df0ab87d-9e0d-478d-a5b7-85a4069772ba" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-493bcefb-5016-4d10-a84a-a456e39a76ae tempest-VolumeDependencyTests-914992643 None] Lock "cinder-quobyte-df0ab87d-9e0d-478d-a5b7-85a4069772ba" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-493bcefb-5016-4d10-a84a-a456e39a76ae tempest-VolumeDependencyTests-914992643 None] Acquiring lock "cinder-quobyte-9ed9f384-86d1-47ed-8b3f-0d9872efe9dc" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:21 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-493bcefb-5016-4d10-a84a-a456e39a76ae tempest-VolumeDependencyTests-914992643 None] Lock "cinder-quobyte-9ed9f384-86d1-47ed-8b3f-0d9872efe9dc" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-493bcefb-5016-4d10-a84a-a456e39a76ae tempest-VolumeDependencyTests-914992643 None] Deleting offline snapshot 9ed9f384-86d1-47ed-8b3f-0d9872efe9dc of volume df0ab87d-9e0d-478d-a5b7-85a4069772ba {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:24:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-493bcefb-5016-4d10-a84a-a456e39a76ae tempest-VolumeDependencyTests-914992643 None] snapshot_file for this snap is: volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:24:21 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cf9592-6328-4319-9147-1538910d1e39]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-493bcefb-5016-4d10-a84a-a456e39a76ae tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:21 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc Jul 22 12:24:21 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:21 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-493bcefb-5016-4d10-a84a-a456e39a76ae tempest-VolumeDependencyTests-914992643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc" returned: 0 in 0.386s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-493bcefb-5016-4d10-a84a-a456e39a76ae tempest-VolumeDependencyTests-914992643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:24:21 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[7750a07d-1e0c-465c-b925-5899977f8813]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-493bcefb-5016-4d10-a84a-a456e39a76ae tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:21 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba Jul 22 12:24:21 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:21 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-493bcefb-5016-4d10-a84a-a456e39a76ae tempest-VolumeDependencyTests-914992643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba" returned: 0 in 0.397s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-493bcefb-5016-4d10-a84a-a456e39a76ae tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:21 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc Jul 22 12:24:21 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:22 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-493bcefb-5016-4d10-a84a-a456e39a76ae tempest-VolumeDependencyTests-914992643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc" returned: 0 in 0.421s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-493bcefb-5016-4d10-a84a-a456e39a76ae tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:22 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc Jul 22 12:24:22 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:22 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-493bcefb-5016-4d10-a84a-a456e39a76ae tempest-VolumeDependencyTests-914992643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba.9ed9f384-86d1-47ed-8b3f-0d9872efe9dc" returned: 0 in 0.297s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-493bcefb-5016-4d10-a84a-a456e39a76ae tempest-VolumeDependencyTests-914992643 None] Lock "cinder-quobyte-9ed9f384-86d1-47ed-8b3f-0d9872efe9dc" released by "_delete_snapshot" :: held 1.646s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-493bcefb-5016-4d10-a84a-a456e39a76ae tempest-VolumeDependencyTests-914992643 None] Lock "cinder-quobyte-df0ab87d-9e0d-478d-a5b7-85a4069772ba" released by "delete_snapshot" :: held 1.685s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:22 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-493bcefb-5016-4d10-a84a-a456e39a76ae tempest-VolumeDependencyTests-914992643 None] Created reservations ['86356fe5-95b2-4cd8-bc7e-67e5a9fbc847', '4189dc89-e107-4b75-9a8b-c4e0de89a931', 'e5920445-fbdb-4420-879a-dd1590490e7a', '1bcea5f8-13ab-4afc-a9ee-2be6b5fa8ce2'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:24:22 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-493bcefb-5016-4d10-a84a-a456e39a76ae tempest-VolumeDependencyTests-914992643 None] Delete snapshot completed successfully. Jul 22 12:24:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-493bcefb-5016-4d10-a84a-a456e39a76ae tempest-VolumeDependencyTests-914992643 None] Lock "cinder-9ed9f384-86d1-47ed-8b3f-0d9872efe9dc-delete_snapshot" released by "delete_snapshot" :: held 1.839s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:22 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:24:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Flow 'volume_create_manager' (3a740c82-5ca1-485b-9a80-a51c6d2e488f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705c0c85-ffbb-4955-9b65-50faacbad6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705c0c85-ffbb-4955-9b65-50faacbad6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5342b083-3698-4365-a0e0-5b3300965ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac3849948bf4dbb8b53a7d80d01bcc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:23Z,use_quota=True,user_id='cd967ce15d1b47f1ab87cd724786c136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c2dfaa-f7df-4b09-9906-435faa44a4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c2dfaa-f7df-4b09-9906-435faa44a4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01070507-6147-4d21-86c3-c6dc4ba8cf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:22 devstack cinder-volume[87568]: DEBUG cinder.image.glance [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Creating Keystone auth plugin from conf {{(pid=87568) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 12:24:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-c80ea2ad-024c-48f4-859f-f00689769ae6 tempest-VolumeDependencyTests-914992643 None] Acquiring lock "cinder-df0ab87d-9e0d-478d-a5b7-85a4069772ba-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-c80ea2ad-024c-48f4-859f-f00689769ae6 tempest-VolumeDependencyTests-914992643 None] Lock "cinder-df0ab87d-9e0d-478d-a5b7-85a4069772ba-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-c80ea2ad-024c-48f4-859f-f00689769ae6 tempest-VolumeDependencyTests-914992643 None] Acquiring lock "cinder-quobyte-df0ab87d-9e0d-478d-a5b7-85a4069772ba" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-c80ea2ad-024c-48f4-859f-f00689769ae6 tempest-VolumeDependencyTests-914992643 None] Lock "cinder-quobyte-df0ab87d-9e0d-478d-a5b7-85a4069772ba" acquired by "delete_volume" :: waited 0.021s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:23 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[8148c2e8-f3f4-4452-b32d-2de0d47182f4]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c80ea2ad-024c-48f4-859f-f00689769ae6 tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01070507-6147-4d21-86c3-c6dc4ba8cf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5342b083-3698-4365-a0e0-5b3300965ae0', 'volume_name': 'volume-5342b083-3698-4365-a0e0-5b3300965ae0', 'volume_size': 1, 'image_id': 'e24377ff-8967-4985-9d8a-8eb1a503a7df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e24377ff-8967-4985-9d8a-8eb1a503a7df', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5b31ef75b791778cc4a31baa3b586253', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fac3849948bf4dbb8b53a7d80d01bcc2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c9161131e374fee09bb428cba1926e782107bb93eb2012fd4c8ac1c87e146713dad286bc5d99e6e1350fdc98eec9cdae5ff3ca06ac6386f59e85ae9948285bfd', 'id': 'e24377ff-8967-4985-9d8a-8eb1a503a7df', 'created_at': datetime.datetime(2026, 7, 22, 10, 24, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 24, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e24377ff-8967-4985-9d8a-8eb1a503a7df/file', 'properties': {}}, 'image_service': }' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27474c67-7b90-443a-9fd4-4809f2d640d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27474c67-7b90-443a-9fd4-4809f2d640d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daacb121-cfdb-4508-8462-e67c8a79c31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:23 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Volume 5342b083-3698-4365-a0e0-5b3300965ae0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5342b083-3698-4365-a0e0-5b3300965ae0', 'volume_size': 1, 'image_id': 'e24377ff-8967-4985-9d8a-8eb1a503a7df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e24377ff-8967-4985-9d8a-8eb1a503a7df', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5b31ef75b791778cc4a31baa3b586253', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fac3849948bf4dbb8b53a7d80d01bcc2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c9161131e374fee09bb428cba1926e782107bb93eb2012fd4c8ac1c87e146713dad286bc5d99e6e1350fdc98eec9cdae5ff3ca06ac6386f59e85ae9948285bfd', 'id': 'e24377ff-8967-4985-9d8a-8eb1a503a7df', 'created_at': datetime.datetime(2026, 7, 22, 10, 24, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 24, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e24377ff-8967-4985-9d8a-8eb1a503a7df/file', 'properties': {}}, 'image_service': } Jul 22 12:24:23 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Trying to clone 5342b083-3698-4365-a0e0-5b3300965ae0 from image e24377ff-8967-4985-9d8a-8eb1a503a7df at location (None, [{'url': 'file:///opt/stack/data/glance/images/e24377ff-8967-4985-9d8a-8eb1a503a7df', 'metadata': {}}]). {{(pid=87568) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 12:24:23 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba Jul 22 12:24:23 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:23 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 12:24:23 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Image download 0.00 MB at 0.00 MB/s Jul 22 12:24:23 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b2d5da-8eb3-406a-8f6d-4214968b9382]: (4, 'raw') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:23 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD Jul 22 12:24:23 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:23 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c80ea2ad-024c-48f4-859f-f00689769ae6 tempest-VolumeDependencyTests-914992643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba" returned: 0 in 0.392s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c80ea2ad-024c-48f4-859f-f00689769ae6 tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:23 devstack sudo[103940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba Jul 22 12:24:23 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:23 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:23 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c80ea2ad-024c-48f4-859f-f00689769ae6 tempest-VolumeDependencyTests-914992643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-df0ab87d-9e0d-478d-a5b7-85a4069772ba" returned: 0 in 0.265s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-c80ea2ad-024c-48f4-859f-f00689769ae6 tempest-VolumeDependencyTests-914992643 None] Lock "cinder-quobyte-df0ab87d-9e0d-478d-a5b7-85a4069772ba" released by "delete_volume" :: held 0.746s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-c80ea2ad-024c-48f4-859f-f00689769ae6 tempest-VolumeDependencyTests-914992643 None] Created reservations ['990771dc-9879-4367-a514-cbb000d4198f', 'c3077da3-73ce-4c77-96d4-4d800e7ce7a3', '4ed4eace-2c7e-421a-89ed-189a563e1545', '8c4d702a-fb44-4801-a4c0-324d51091224'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:24:24 devstack sudo[103945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD Jul 22 12:24:24 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c80ea2ad-024c-48f4-859f-f00689769ae6 tempest-VolumeDependencyTests-914992643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c80ea2ad-024c-48f4-859f-f00689769ae6 tempest-VolumeDependencyTests-914992643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-c80ea2ad-024c-48f4-859f-f00689769ae6 tempest-VolumeDependencyTests-914992643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-c80ea2ad-024c-48f4-859f-f00689769ae6 tempest-VolumeDependencyTests-914992643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c80ea2ad-024c-48f4-859f-f00689769ae6 tempest-VolumeDependencyTests-914992643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c80ea2ad-024c-48f4-859f-f00689769ae6 tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:24 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:24:24 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:24 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-95a31799-1d26-47c8-9c57-688a68f5c26c tempest-VolumeDependencyTests-914992643 None] Acquiring lock "cinder-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD" returned: 1 in 0.537s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Temporary image e24377ff-8967-4985-9d8a-8eb1a503a7df is fetched for user cd967ce15d1b47f1ab87cd724786c136. {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 12:24:24 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:24:24 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-95a31799-1d26-47c8-9c57-688a68f5c26c tempest-VolumeDependencyTests-914992643 None] Lock "cinder-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-95a31799-1d26-47c8-9c57-688a68f5c26c tempest-VolumeDependencyTests-914992643 None] Acquiring lock "cinder-quobyte-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:24 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c80ea2ad-024c-48f4-859f-f00689769ae6 tempest-VolumeDependencyTests-914992643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.454s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-c80ea2ad-024c-48f4-859f-f00689769ae6 tempest-VolumeDependencyTests-914992643 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:24:24 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-c80ea2ad-024c-48f4-859f-f00689769ae6 tempest-VolumeDependencyTests-914992643 None] Deleted volume successfully. Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-95a31799-1d26-47c8-9c57-688a68f5c26c tempest-VolumeDependencyTests-914992643 None] Lock "cinder-quobyte-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79" acquired by "delete_volume" :: waited 0.031s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8f5ac6-2dfd-4ac1-9465-ebcd2dff4f50]: (4, 'raw') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1ab74b-c2c2-4e92-9b7b-66c4740f4d86]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95a31799-1d26-47c8-9c57-688a68f5c26c tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-c80ea2ad-024c-48f4-859f-f00689769ae6 tempest-VolumeDependencyTests-914992643 None] Lock "cinder-df0ab87d-9e0d-478d-a5b7-85a4069772ba-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:24 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.425s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:24:24 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79 Jul 22 12:24:24 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread count: 28 {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:24:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread info: [<_MainThread(MainThread, started 137793405739136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:24:24 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD Jul 22 12:24:24 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:25 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD" returned: 0 in 0.518s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:25 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95a31799-1d26-47c8-9c57-688a68f5c26c tempest-VolumeDependencyTests-914992643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79" returned: 0 in 0.527s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95a31799-1d26-47c8-9c57-688a68f5c26c tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:25 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79 Jul 22 12:24:25 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:25 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD Jul 22 12:24:25 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:25 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95a31799-1d26-47c8-9c57-688a68f5c26c tempest-VolumeDependencyTests-914992643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79" returned: 0 in 0.309s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-95a31799-1d26-47c8-9c57-688a68f5c26c tempest-VolumeDependencyTests-914992643 None] Lock "cinder-quobyte-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79" released by "delete_volume" :: held 0.911s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:25 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD" returned: 1 in 0.384s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5342b083-3698-4365-a0e0-5b3300965ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac3849948bf4dbb8b53a7d80d01bcc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:23Z,use_quota=True,user_id='cd967ce15d1b47f1ab87cd724786c136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Creating volume 5342b083-3698-4365-a0e0-5b3300965ae0 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:24:25 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5342b083-3698-4365-a0e0-5b3300965ae0 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:25 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5342b083-3698-4365-a0e0-5b3300965ae0 1073741824 Jul 22 12:24:25 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-95a31799-1d26-47c8-9c57-688a68f5c26c tempest-VolumeDependencyTests-914992643 None] Created reservations ['28bb6716-4003-4574-82f7-3e05260b5248', '345c4ace-6a6a-417a-86b9-0b0c2fea9130', '303ffea9-ac3c-47c5-8887-3d1af8bef138', '1b7ac0e0-8426-4a72-8f21-4c10d2d2492e'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-95a31799-1d26-47c8-9c57-688a68f5c26c tempest-VolumeDependencyTests-914992643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-95a31799-1d26-47c8-9c57-688a68f5c26c tempest-VolumeDependencyTests-914992643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-95a31799-1d26-47c8-9c57-688a68f5c26c tempest-VolumeDependencyTests-914992643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-95a31799-1d26-47c8-9c57-688a68f5c26c tempest-VolumeDependencyTests-914992643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-95a31799-1d26-47c8-9c57-688a68f5c26c tempest-VolumeDependencyTests-914992643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95a31799-1d26-47c8-9c57-688a68f5c26c tempest-VolumeDependencyTests-914992643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:25 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:24:25 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:25 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95a31799-1d26-47c8-9c57-688a68f5c26c tempest-VolumeDependencyTests-914992643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.274s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:25 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-95a31799-1d26-47c8-9c57-688a68f5c26c tempest-VolumeDependencyTests-914992643 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:24:26 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-95a31799-1d26-47c8-9c57-688a68f5c26c tempest-VolumeDependencyTests-914992643 None] Deleted volume successfully. Jul 22 12:24:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-95a31799-1d26-47c8-9c57-688a68f5c26c tempest-VolumeDependencyTests-914992643 None] Lock "cinder-fca0d0a3-9b17-4eab-80a3-48d9f9f34b79-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:26 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5342b083-3698-4365-a0e0-5b3300965ae0 1073741824" returned: 0 in 0.479s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5342b083-3698-4365-a0e0-5b3300965ae0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:26 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5342b083-3698-4365-a0e0-5b3300965ae0 Jul 22 12:24:26 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:26 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5342b083-3698-4365-a0e0-5b3300965ae0" returned: 0 in 0.247s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:24:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:26 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Attempting download of e24377ff-8967-4985-9d8a-8eb1a503a7df ((None, [{'url': 'file:///opt/stack/data/glance/images/e24377ff-8967-4985-9d8a-8eb1a503a7df', 'metadata': {}}])) to volume 5342b083-3698-4365-a0e0-5b3300965ae0. {{(pid=87568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 12:24:26 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c3aebf-e96b-48c0-90d1-a5cdd2861a1d]: (4, 'raw') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e24377ff-8967-4985-9d8a-8eb1a503a7df_ss9mqust {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:26 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e24377ff-8967-4985-9d8a-8eb1a503a7df_ss9mqust Jul 22 12:24:26 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:26 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e24377ff-8967-4985-9d8a-8eb1a503a7df_ss9mqust" returned: 0 in 0.342s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e24377ff-8967-4985-9d8a-8eb1a503a7df_ss9mqust {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:26 devstack sudo[104025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e24377ff-8967-4985-9d8a-8eb1a503a7df_ss9mqust Jul 22 12:24:26 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:27 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e24377ff-8967-4985-9d8a-8eb1a503a7df_ss9mqust" returned: 1 in 0.347s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e24377ff-8967-4985-9d8a-8eb1a503a7df_ss9mqust' failed. Not Retrying. {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:24:27 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c6894a-4e84-467a-9f3b-17a85bd1301b]: (4, 'raw') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:27 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD Jul 22 12:24:27 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:27 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:27 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD Jul 22 12:24:27 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:27 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD" returned: 1 in 0.341s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:24:27 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] e24377ff-8967-4985-9d8a-8eb1a503a7df was raw, converting to qcow2 {{(pid=87568) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 12:24:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5342b083-3698-4365-a0e0-5b3300965ae0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:27 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5342b083-3698-4365-a0e0-5b3300965ae0 Jul 22 12:24:27 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:28 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5342b083-3698-4365-a0e0-5b3300965ae0" returned: 0 in 0.488s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:28 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e24377ff-8967-4985-9d8a-8eb1a503a7df_asiov2cudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5342b083-3698-4365-a0e0-5b3300965ae0 {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:24:28 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Converted 0.00 MB image at 0.00 MB/s Jul 22 12:24:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5342b083-3698-4365-a0e0-5b3300965ae0 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:28 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5342b083-3698-4365-a0e0-5b3300965ae0 1G Jul 22 12:24:28 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:28 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5342b083-3698-4365-a0e0-5b3300965ae0 1G" returned: 0 in 0.320s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:28 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Downloaded image e24377ff-8967-4985-9d8a-8eb1a503a7df ((None, [{'url': 'file:///opt/stack/data/glance/images/e24377ff-8967-4985-9d8a-8eb1a503a7df', 'metadata': {}}])) to volume 5342b083-3698-4365-a0e0-5b3300965ae0 successfully. {{(pid=87568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 12:24:28 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Temporary image e24377ff-8967-4985-9d8a-8eb1a503a7df for user cd967ce15d1b47f1ab87cd724786c136 is deleted. {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 12:24:28 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Marking volume 5342b083-3698-4365-a0e0-5b3300965ae0 as bootable. {{(pid=87568) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 12:24:28 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Copying metadata from image e24377ff-8967-4985-9d8a-8eb1a503a7df to 5342b083-3698-4365-a0e0-5b3300965ae0. {{(pid=87568) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 12:24:28 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Creating volume glance metadata for volume 5342b083-3698-4365-a0e0-5b3300965ae0 backed by image e24377ff-8967-4985-9d8a-8eb1a503a7df with: {'image_id': 'e24377ff-8967-4985-9d8a-8eb1a503a7df', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5b31ef75b791778cc4a31baa3b586253', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87568) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 12:24:28 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daacb121-cfdb-4508-8462-e67c8a79c31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5342b083-3698-4365-a0e0-5b3300965ae0', 'volume_size': 1, 'image_id': 'e24377ff-8967-4985-9d8a-8eb1a503a7df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e24377ff-8967-4985-9d8a-8eb1a503a7df', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5b31ef75b791778cc4a31baa3b586253', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fac3849948bf4dbb8b53a7d80d01bcc2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c9161131e374fee09bb428cba1926e782107bb93eb2012fd4c8ac1c87e146713dad286bc5d99e6e1350fdc98eec9cdae5ff3ca06ac6386f59e85ae9948285bfd', 'id': 'e24377ff-8967-4985-9d8a-8eb1a503a7df', 'created_at': datetime.datetime(2026, 7, 22, 10, 24, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 24, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e24377ff-8967-4985-9d8a-8eb1a503a7df/file', 'properties': {}}, 'image_service': }' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:28 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe39b6d2-7569-421c-8ead-8cc5ff3a368a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:28 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Volume volume-5342b083-3698-4365-a0e0-5b3300965ae0 (5342b083-3698-4365-a0e0-5b3300965ae0): created successfully Jul 22 12:24:28 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe39b6d2-7569-421c-8ead-8cc5ff3a368a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:28 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Flow 'volume_create_manager' (3a740c82-5ca1-485b-9a80-a51c6d2e488f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:28 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-89efa5f1-c3f1-45f7-99a2-7242de991d33 tempest-VolumeImageDependencyTests-375499071 None] Created volume successfully. Jul 22 12:24:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-49381466-a623-43a6-9c89-1dee0b1e023b tempest-VolumeImageDependencyTests-375499071 None] Acquiring lock "cinder-5342b083-3698-4365-a0e0-5b3300965ae0-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-49381466-a623-43a6-9c89-1dee0b1e023b tempest-VolumeImageDependencyTests-375499071 None] Lock "cinder-5342b083-3698-4365-a0e0-5b3300965ae0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-49381466-a623-43a6-9c89-1dee0b1e023b tempest-VolumeImageDependencyTests-375499071 None] Acquiring lock "cinder-quobyte-5342b083-3698-4365-a0e0-5b3300965ae0" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-49381466-a623-43a6-9c89-1dee0b1e023b tempest-VolumeImageDependencyTests-375499071 None] Lock "cinder-quobyte-5342b083-3698-4365-a0e0-5b3300965ae0" acquired by "delete_volume" :: waited 0.016s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:29 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9b9100-b239-42cf-afaa-6c71855b9fc6]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-49381466-a623-43a6-9c89-1dee0b1e023b tempest-VolumeImageDependencyTests-375499071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5342b083-3698-4365-a0e0-5b3300965ae0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:29 devstack sudo[104049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5342b083-3698-4365-a0e0-5b3300965ae0 Jul 22 12:24:29 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:29 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-49381466-a623-43a6-9c89-1dee0b1e023b tempest-VolumeImageDependencyTests-375499071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5342b083-3698-4365-a0e0-5b3300965ae0" returned: 0 in 0.379s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-49381466-a623-43a6-9c89-1dee0b1e023b tempest-VolumeImageDependencyTests-375499071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5342b083-3698-4365-a0e0-5b3300965ae0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:29 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5342b083-3698-4365-a0e0-5b3300965ae0 Jul 22 12:24:29 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:30 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-49381466-a623-43a6-9c89-1dee0b1e023b tempest-VolumeImageDependencyTests-375499071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5342b083-3698-4365-a0e0-5b3300965ae0" returned: 0 in 0.253s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-49381466-a623-43a6-9c89-1dee0b1e023b tempest-VolumeImageDependencyTests-375499071 None] Lock "cinder-quobyte-5342b083-3698-4365-a0e0-5b3300965ae0" released by "delete_volume" :: held 0.677s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:30 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-49381466-a623-43a6-9c89-1dee0b1e023b tempest-VolumeImageDependencyTests-375499071 None] Created reservations ['ead2b501-0708-44d2-88e4-a005841e0357', 'e5fabaa9-e89e-40fc-ae23-b8fdf9c9e744', '0307e3c6-ae26-4e47-8fbd-1b276a709045', '1ee7f637-b653-4ffa-b13c-baf988cdc3cc'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:24:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-49381466-a623-43a6-9c89-1dee0b1e023b tempest-VolumeImageDependencyTests-375499071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-49381466-a623-43a6-9c89-1dee0b1e023b tempest-VolumeImageDependencyTests-375499071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-49381466-a623-43a6-9c89-1dee0b1e023b tempest-VolumeImageDependencyTests-375499071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-49381466-a623-43a6-9c89-1dee0b1e023b tempest-VolumeImageDependencyTests-375499071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-49381466-a623-43a6-9c89-1dee0b1e023b tempest-VolumeImageDependencyTests-375499071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-49381466-a623-43a6-9c89-1dee0b1e023b tempest-VolumeImageDependencyTests-375499071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:30 devstack sudo[104057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:24:30 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:30 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-49381466-a623-43a6-9c89-1dee0b1e023b tempest-VolumeImageDependencyTests-375499071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.300s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:30 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-49381466-a623-43a6-9c89-1dee0b1e023b tempest-VolumeImageDependencyTests-375499071 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:24:30 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-49381466-a623-43a6-9c89-1dee0b1e023b tempest-VolumeImageDependencyTests-375499071 None] Deleted volume successfully. Jul 22 12:24:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-49381466-a623-43a6-9c89-1dee0b1e023b tempest-VolumeImageDependencyTests-375499071 None] Lock "cinder-5342b083-3698-4365-a0e0-5b3300965ae0-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Flow 'volume_create_manager' (ec864a8e-c465-461c-b428-00404272a61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a7f28f-c451-4b5a-b7d7-b11ac630e49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a7f28f-c451-4b5a-b7d7-b11ac630e49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1617290583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e747a4d8fb4f0ba05993eadc59c44c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:34Z,use_quota=True,user_id='536e667d40aa42e8b8b84214272d05f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6047d7-64d3-467b-9b0c-4539163cc673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6047d7-64d3-467b-9b0c-4539163cc673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b3ad25-99f9-4e42-afd6-7a3d9b3dab56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b3ad25-99f9-4e42-afd6-7a3d9b3dab56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b', 'volume_name': 'volume-13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ddb2f8-1199-4416-b39c-1e06be79640a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ddb2f8-1199-4416-b39c-1e06be79640a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbac6e7-8ee3-4282-bd13-5ed0f61bd22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:34 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Volume 13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b', 'volume_size': 1} Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1617290583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e747a4d8fb4f0ba05993eadc59c44c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:34Z,use_quota=True,user_id='536e667d40aa42e8b8b84214272d05f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Creating volume 13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:24:34 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:34 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b 1073741824 Jul 22 12:24:34 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:34 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b 1073741824" returned: 0 in 0.468s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:35 devstack sudo[104068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b Jul 22 12:24:35 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Flow 'volume_create_manager' (10c4717a-666e-4973-b76f-bc7f73f8b76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58130708-fda8-47b3-9ddc-3b041e5cfc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58130708-fda8-47b3-9ddc-3b041e5cfc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2120800508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29019e2f-4e7d-4bd7-bbd4-866ee2927987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f11562323a4ac4a702a784e8737c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:35Z,use_quota=True,user_id='259083df7aea4031969495e32e56df1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060259d9-8e74-401e-a475-6aa7536fa24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060259d9-8e74-401e-a475-6aa7536fa24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0809c7ed-ad4b-4fc1-9d08-748fc78d4df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0809c7ed-ad4b-4fc1-9d08-748fc78d4df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29019e2f-4e7d-4bd7-bbd4-866ee2927987', 'volume_name': 'volume-29019e2f-4e7d-4bd7-bbd4-866ee2927987', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029fe65e-f166-42ff-ae53-4a0fd8aa83c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029fe65e-f166-42ff-ae53-4a0fd8aa83c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ceb27c-008c-44d2-bb27-18f357f17988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:35 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Volume 29019e2f-4e7d-4bd7-bbd4-866ee2927987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29019e2f-4e7d-4bd7-bbd4-866ee2927987', 'volume_size': 1} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:35 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b" returned: 0 in 0.265s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.143s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2120800508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29019e2f-4e7d-4bd7-bbd4-866ee2927987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f11562323a4ac4a702a784e8737c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:35Z,use_quota=True,user_id='259083df7aea4031969495e32e56df1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Creating volume 29019e2f-4e7d-4bd7-bbd4-866ee2927987 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:24:35 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-29019e2f-4e7d-4bd7-bbd4-866ee2927987 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbac6e7-8ee3-4282-bd13-5ed0f61bd22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:35 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-29019e2f-4e7d-4bd7-bbd4-866ee2927987 1073741824 Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4341722c-2638-4713-8fa7-a8f70f32e8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:35 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:35 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Volume volume-13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b (13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b): created successfully Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4341722c-2638-4713-8fa7-a8f70f32e8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Flow 'volume_create_manager' (ec864a8e-c465-461c-b428-00404272a61e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:35 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-79623bf7-f789-4259-a7be-b641be491df6 tempest-ProjectReaderTests-851655822 None] Created volume successfully. Jul 22 12:24:35 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-29019e2f-4e7d-4bd7-bbd4-866ee2927987 1073741824" returned: 0 in 0.405s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-29019e2f-4e7d-4bd7-bbd4-866ee2927987 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:35 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-29019e2f-4e7d-4bd7-bbd4-866ee2927987 Jul 22 12:24:35 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:35 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-29019e2f-4e7d-4bd7-bbd4-866ee2927987" returned: 0 in 0.256s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:24:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ceb27c-008c-44d2-bb27-18f357f17988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29019e2f-4e7d-4bd7-bbd4-866ee2927987', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d9c4e9-012a-4571-82e9-7aec0b2db6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:36 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Volume volume-29019e2f-4e7d-4bd7-bbd4-866ee2927987 (29019e2f-4e7d-4bd7-bbd4-866ee2927987): created successfully Jul 22 12:24:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d9c4e9-012a-4571-82e9-7aec0b2db6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Flow 'volume_create_manager' (10c4717a-666e-4973-b76f-bc7f73f8b76f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:36 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-f5cc2032-703d-4fda-a522-23f95727e0aa tempest-ProjectReaderTests-803812786 None] Created volume successfully. Jul 22 12:24:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20e18d4f-829c-42d2-a853-f08b1d5d8924 tempest-ProjectReaderTests-851655822 None] Acquiring lock "cinder-13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20e18d4f-829c-42d2-a853-f08b1d5d8924 tempest-ProjectReaderTests-851655822 None] Lock "cinder-13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20e18d4f-829c-42d2-a853-f08b1d5d8924 tempest-ProjectReaderTests-851655822 None] Acquiring lock "cinder-quobyte-13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20e18d4f-829c-42d2-a853-f08b1d5d8924 tempest-ProjectReaderTests-851655822 None] Lock "cinder-quobyte-13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b" acquired by "delete_volume" :: waited 0.015s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:36 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadcef8f-c08f-4912-baa8-5b6e19dd3efd]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20e18d4f-829c-42d2-a853-f08b1d5d8924 tempest-ProjectReaderTests-851655822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:36 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b Jul 22 12:24:36 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:37 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20e18d4f-829c-42d2-a853-f08b1d5d8924 tempest-ProjectReaderTests-851655822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b" returned: 0 in 0.358s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20e18d4f-829c-42d2-a853-f08b1d5d8924 tempest-ProjectReaderTests-851655822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:37 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b Jul 22 12:24:37 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-73037002-0164-42cf-be1e-ba80e443c566 tempest-ProjectReaderTests-803812786 None] Acquiring lock "cinder-29019e2f-4e7d-4bd7-bbd4-866ee2927987-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-73037002-0164-42cf-be1e-ba80e443c566 tempest-ProjectReaderTests-803812786 None] Lock "cinder-29019e2f-4e7d-4bd7-bbd4-866ee2927987-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-73037002-0164-42cf-be1e-ba80e443c566 tempest-ProjectReaderTests-803812786 None] Acquiring lock "cinder-quobyte-29019e2f-4e7d-4bd7-bbd4-866ee2927987" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-73037002-0164-42cf-be1e-ba80e443c566 tempest-ProjectReaderTests-803812786 None] Lock "cinder-quobyte-29019e2f-4e7d-4bd7-bbd4-866ee2927987" acquired by "delete_volume" :: waited 0.014s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:37 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20e18d4f-829c-42d2-a853-f08b1d5d8924 tempest-ProjectReaderTests-851655822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b" returned: 0 in 0.271s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20e18d4f-829c-42d2-a853-f08b1d5d8924 tempest-ProjectReaderTests-851655822 None] Lock "cinder-quobyte-13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b" released by "delete_volume" :: held 0.665s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:37 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09befaf-afa8-4569-bb57-eaa22664adae]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-73037002-0164-42cf-be1e-ba80e443c566 tempest-ProjectReaderTests-803812786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-29019e2f-4e7d-4bd7-bbd4-866ee2927987 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:37 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-20e18d4f-829c-42d2-a853-f08b1d5d8924 tempest-ProjectReaderTests-851655822 None] Created reservations ['6aec279e-2087-4edb-b7e9-771a27230e49', 'eaf7ec68-fa5b-4851-984f-3af3b2dac58c', '7646e753-2a8d-4eff-a2a7-39c3fad1ad0d', '506fb6eb-d5a0-429d-bc68-e1f0f218f20b'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:24:37 devstack sudo[104094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-29019e2f-4e7d-4bd7-bbd4-866ee2927987 Jul 22 12:24:37 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-20e18d4f-829c-42d2-a853-f08b1d5d8924 tempest-ProjectReaderTests-851655822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-20e18d4f-829c-42d2-a853-f08b1d5d8924 tempest-ProjectReaderTests-851655822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-20e18d4f-829c-42d2-a853-f08b1d5d8924 tempest-ProjectReaderTests-851655822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-20e18d4f-829c-42d2-a853-f08b1d5d8924 tempest-ProjectReaderTests-851655822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-20e18d4f-829c-42d2-a853-f08b1d5d8924 tempest-ProjectReaderTests-851655822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20e18d4f-829c-42d2-a853-f08b1d5d8924 tempest-ProjectReaderTests-851655822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:37 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:24:37 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:37 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:37 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-73037002-0164-42cf-be1e-ba80e443c566 tempest-ProjectReaderTests-803812786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-29019e2f-4e7d-4bd7-bbd4-866ee2927987" returned: 0 in 0.374s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-73037002-0164-42cf-be1e-ba80e443c566 tempest-ProjectReaderTests-803812786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-29019e2f-4e7d-4bd7-bbd4-866ee2927987 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20e18d4f-829c-42d2-a853-f08b1d5d8924 tempest-ProjectReaderTests-851655822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.256s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:37 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-20e18d4f-829c-42d2-a853-f08b1d5d8924 tempest-ProjectReaderTests-851655822 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:24:37 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-20e18d4f-829c-42d2-a853-f08b1d5d8924 tempest-ProjectReaderTests-851655822 None] Deleted volume successfully. Jul 22 12:24:37 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-29019e2f-4e7d-4bd7-bbd4-866ee2927987 Jul 22 12:24:37 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20e18d4f-829c-42d2-a853-f08b1d5d8924 tempest-ProjectReaderTests-851655822 None] Lock "cinder-13fbafe6-e68f-4108-b1b7-d8f37cb4ce9b-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:38 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-73037002-0164-42cf-be1e-ba80e443c566 tempest-ProjectReaderTests-803812786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-29019e2f-4e7d-4bd7-bbd4-866ee2927987" returned: 0 in 0.264s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-73037002-0164-42cf-be1e-ba80e443c566 tempest-ProjectReaderTests-803812786 None] Lock "cinder-quobyte-29019e2f-4e7d-4bd7-bbd4-866ee2927987" released by "delete_volume" :: held 0.688s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-73037002-0164-42cf-be1e-ba80e443c566 tempest-ProjectReaderTests-803812786 None] Created reservations ['7a67efc8-8833-4fdc-9e29-2811caa56124', 'c561a413-d09f-4415-ab68-b7c059f6b0e7', '09a7a406-f8bc-435a-bb17-3646b84a0d41', 'be9d991f-303c-477d-9d06-704ef65e89fd'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-73037002-0164-42cf-be1e-ba80e443c566 tempest-ProjectReaderTests-803812786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-73037002-0164-42cf-be1e-ba80e443c566 tempest-ProjectReaderTests-803812786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-73037002-0164-42cf-be1e-ba80e443c566 tempest-ProjectReaderTests-803812786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-73037002-0164-42cf-be1e-ba80e443c566 tempest-ProjectReaderTests-803812786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-73037002-0164-42cf-be1e-ba80e443c566 tempest-ProjectReaderTests-803812786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-73037002-0164-42cf-be1e-ba80e443c566 tempest-ProjectReaderTests-803812786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:38 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:24:38 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Flow 'volume_create_manager' (6a7929a2-9dfe-43fc-b1d7-9fb3244dfac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275e99c0-194f-4a60-bcba-f5afdefef3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275e99c0-194f-4a60-bcba-f5afdefef3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-695100678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19fd87b-47d3-44b5-8023-eb8884973539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e747a4d8fb4f0ba05993eadc59c44c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:38Z,use_quota=True,user_id='536e667d40aa42e8b8b84214272d05f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c15a8ca-4e8f-4cb9-963d-ccd0a17d5899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c15a8ca-4e8f-4cb9-963d-ccd0a17d5899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbdee6d2-540e-4a8b-b486-378700458061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbdee6d2-540e-4a8b-b486-378700458061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd19fd87b-47d3-44b5-8023-eb8884973539', 'volume_name': 'volume-d19fd87b-47d3-44b5-8023-eb8884973539', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed52f06-1597-4451-a570-42624e498014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed52f06-1597-4451-a570-42624e498014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30eee47e-2c04-482d-8b8a-686ecbcf0a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:38 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Volume d19fd87b-47d3-44b5-8023-eb8884973539: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d19fd87b-47d3-44b5-8023-eb8884973539', 'volume_size': 1} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-695100678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19fd87b-47d3-44b5-8023-eb8884973539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e747a4d8fb4f0ba05993eadc59c44c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:38Z,use_quota=True,user_id='536e667d40aa42e8b8b84214272d05f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Creating volume d19fd87b-47d3-44b5-8023-eb8884973539 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:24:38 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d19fd87b-47d3-44b5-8023-eb8884973539 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:38 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d19fd87b-47d3-44b5-8023-eb8884973539 1073741824 Jul 22 12:24:38 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:38 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-73037002-0164-42cf-be1e-ba80e443c566 tempest-ProjectReaderTests-803812786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.256s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-73037002-0164-42cf-be1e-ba80e443c566 tempest-ProjectReaderTests-803812786 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:24:38 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-73037002-0164-42cf-be1e-ba80e443c566 tempest-ProjectReaderTests-803812786 None] Deleted volume successfully. Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-73037002-0164-42cf-be1e-ba80e443c566 tempest-ProjectReaderTests-803812786 None] Lock "cinder-29019e2f-4e7d-4bd7-bbd4-866ee2927987-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:38 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d19fd87b-47d3-44b5-8023-eb8884973539 1073741824" returned: 0 in 0.469s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d19fd87b-47d3-44b5-8023-eb8884973539 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:38 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d19fd87b-47d3-44b5-8023-eb8884973539 Jul 22 12:24:38 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Flow 'volume_create_manager' (a35981fc-fbc9-4dc8-bd42-e3fbe3792b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded4de05-3f6b-466d-b6f1-fcd6db99d4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded4de05-3f6b-466d-b6f1-fcd6db99d4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1384395781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43993946-9c62-42f6-aa40-e9733ec01225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f11562323a4ac4a702a784e8737c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:39Z,use_quota=True,user_id='259083df7aea4031969495e32e56df1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecacd569-3ea6-47f7-978b-5b44711fee8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecacd569-3ea6-47f7-978b-5b44711fee8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e310856-dfc0-4af8-97b0-2085b25f6dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e310856-dfc0-4af8-97b0-2085b25f6dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43993946-9c62-42f6-aa40-e9733ec01225', 'volume_name': 'volume-43993946-9c62-42f6-aa40-e9733ec01225', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684d81f1-262d-4e6c-8a2a-9bf5e3b1552a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684d81f1-262d-4e6c-8a2a-9bf5e3b1552a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a57e66f7-2fb0-4288-b62f-9e92d60eede8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:38 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Volume 43993946-9c62-42f6-aa40-e9733ec01225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43993946-9c62-42f6-aa40-e9733ec01225', 'volume_size': 1} Jul 22 12:24:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:39 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d19fd87b-47d3-44b5-8023-eb8884973539" returned: 0 in 0.259s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.127s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1384395781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43993946-9c62-42f6-aa40-e9733ec01225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f11562323a4ac4a702a784e8737c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:39Z,use_quota=True,user_id='259083df7aea4031969495e32e56df1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Creating volume 43993946-9c62-42f6-aa40-e9733ec01225 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:24:39 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-43993946-9c62-42f6-aa40-e9733ec01225 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30eee47e-2c04-482d-8b8a-686ecbcf0a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d19fd87b-47d3-44b5-8023-eb8884973539', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:39 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-43993946-9c62-42f6-aa40-e9733ec01225 1073741824 Jul 22 12:24:39 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de05f9c5-950f-462e-a47e-5d162c8efeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:39 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Volume volume-d19fd87b-47d3-44b5-8023-eb8884973539 (d19fd87b-47d3-44b5-8023-eb8884973539): created successfully Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de05f9c5-950f-462e-a47e-5d162c8efeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Flow 'volume_create_manager' (6a7929a2-9dfe-43fc-b1d7-9fb3244dfac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:39 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-fa05d4aa-5cc9-407c-8b3d-d0174d488516 tempest-ProjectReaderTests-851655822 None] Created volume successfully. Jul 22 12:24:39 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-43993946-9c62-42f6-aa40-e9733ec01225 1073741824" returned: 0 in 0.425s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-43993946-9c62-42f6-aa40-e9733ec01225 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:39 devstack sudo[104122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-43993946-9c62-42f6-aa40-e9733ec01225 Jul 22 12:24:39 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:39 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-43993946-9c62-42f6-aa40-e9733ec01225" returned: 0 in 0.258s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a57e66f7-2fb0-4288-b62f-9e92d60eede8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43993946-9c62-42f6-aa40-e9733ec01225', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b24b91-3311-40b7-bfab-e9874293b879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:39 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Volume volume-43993946-9c62-42f6-aa40-e9733ec01225 (43993946-9c62-42f6-aa40-e9733ec01225): created successfully Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b24b91-3311-40b7-bfab-e9874293b879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Flow 'volume_create_manager' (a35981fc-fbc9-4dc8-bd42-e3fbe3792b2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:39 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-0936cb0a-e3a2-43c4-926a-529a50e49371 tempest-ProjectReaderTests-803812786 None] Created volume successfully. Jul 22 12:24:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7792ced6-efc2-429a-b1b9-ed7aeceb1794 tempest-ProjectReaderTests-851655822 None] Acquiring lock "cinder-d19fd87b-47d3-44b5-8023-eb8884973539-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7792ced6-efc2-429a-b1b9-ed7aeceb1794 tempest-ProjectReaderTests-851655822 None] Lock "cinder-d19fd87b-47d3-44b5-8023-eb8884973539-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7792ced6-efc2-429a-b1b9-ed7aeceb1794 tempest-ProjectReaderTests-851655822 None] Acquiring lock "cinder-quobyte-d19fd87b-47d3-44b5-8023-eb8884973539" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7792ced6-efc2-429a-b1b9-ed7aeceb1794 tempest-ProjectReaderTests-851655822 None] Lock "cinder-quobyte-d19fd87b-47d3-44b5-8023-eb8884973539" acquired by "delete_volume" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:40 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[54762f3d-4ee3-4709-9f86-db2b47d5cbd7]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7792ced6-efc2-429a-b1b9-ed7aeceb1794 tempest-ProjectReaderTests-851655822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d19fd87b-47d3-44b5-8023-eb8884973539 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:40 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d19fd87b-47d3-44b5-8023-eb8884973539 Jul 22 12:24:40 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:40 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7792ced6-efc2-429a-b1b9-ed7aeceb1794 tempest-ProjectReaderTests-851655822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d19fd87b-47d3-44b5-8023-eb8884973539" returned: 0 in 0.348s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7792ced6-efc2-429a-b1b9-ed7aeceb1794 tempest-ProjectReaderTests-851655822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d19fd87b-47d3-44b5-8023-eb8884973539 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:40 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d19fd87b-47d3-44b5-8023-eb8884973539 Jul 22 12:24:40 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b7090051-dc37-4bbd-a2c6-1773aaf6bfbd tempest-ProjectReaderTests-803812786 None] Acquiring lock "cinder-43993946-9c62-42f6-aa40-e9733ec01225-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b7090051-dc37-4bbd-a2c6-1773aaf6bfbd tempest-ProjectReaderTests-803812786 None] Lock "cinder-43993946-9c62-42f6-aa40-e9733ec01225-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b7090051-dc37-4bbd-a2c6-1773aaf6bfbd tempest-ProjectReaderTests-803812786 None] Acquiring lock "cinder-quobyte-43993946-9c62-42f6-aa40-e9733ec01225" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b7090051-dc37-4bbd-a2c6-1773aaf6bfbd tempest-ProjectReaderTests-803812786 None] Lock "cinder-quobyte-43993946-9c62-42f6-aa40-e9733ec01225" acquired by "delete_volume" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dbf830-4a13-4871-a1ba-1d1159600e0d]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b7090051-dc37-4bbd-a2c6-1773aaf6bfbd tempest-ProjectReaderTests-803812786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-43993946-9c62-42f6-aa40-e9733ec01225 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:41 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7792ced6-efc2-429a-b1b9-ed7aeceb1794 tempest-ProjectReaderTests-851655822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d19fd87b-47d3-44b5-8023-eb8884973539" returned: 0 in 0.294s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7792ced6-efc2-429a-b1b9-ed7aeceb1794 tempest-ProjectReaderTests-851655822 None] Lock "cinder-quobyte-d19fd87b-47d3-44b5-8023-eb8884973539" released by "delete_volume" :: held 0.684s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-7792ced6-efc2-429a-b1b9-ed7aeceb1794 tempest-ProjectReaderTests-851655822 None] Created reservations ['6bc5a284-d4a3-4223-a896-3a402680f33c', 'fe7dc15e-4703-4ca7-ae39-e961c40a6b4e', '5af0afe1-09f1-4d46-90c4-e66b3480a891', '71ceee0d-3ff0-4376-8508-99d83c83c4c4'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:24:41 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-43993946-9c62-42f6-aa40-e9733ec01225 Jul 22 12:24:41 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7792ced6-efc2-429a-b1b9-ed7aeceb1794 tempest-ProjectReaderTests-851655822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7792ced6-efc2-429a-b1b9-ed7aeceb1794 tempest-ProjectReaderTests-851655822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7792ced6-efc2-429a-b1b9-ed7aeceb1794 tempest-ProjectReaderTests-851655822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7792ced6-efc2-429a-b1b9-ed7aeceb1794 tempest-ProjectReaderTests-851655822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7792ced6-efc2-429a-b1b9-ed7aeceb1794 tempest-ProjectReaderTests-851655822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7792ced6-efc2-429a-b1b9-ed7aeceb1794 tempest-ProjectReaderTests-851655822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:41 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:24:41 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:41 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b7090051-dc37-4bbd-a2c6-1773aaf6bfbd tempest-ProjectReaderTests-803812786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-43993946-9c62-42f6-aa40-e9733ec01225" returned: 0 in 0.373s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b7090051-dc37-4bbd-a2c6-1773aaf6bfbd tempest-ProjectReaderTests-803812786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-43993946-9c62-42f6-aa40-e9733ec01225 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:41 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7792ced6-efc2-429a-b1b9-ed7aeceb1794 tempest-ProjectReaderTests-851655822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.255s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-7792ced6-efc2-429a-b1b9-ed7aeceb1794 tempest-ProjectReaderTests-851655822 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:24:41 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-43993946-9c62-42f6-aa40-e9733ec01225 Jul 22 12:24:41 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:41 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-7792ced6-efc2-429a-b1b9-ed7aeceb1794 tempest-ProjectReaderTests-851655822 None] Deleted volume successfully. Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7792ced6-efc2-429a-b1b9-ed7aeceb1794 tempest-ProjectReaderTests-851655822 None] Lock "cinder-d19fd87b-47d3-44b5-8023-eb8884973539-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:41 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b7090051-dc37-4bbd-a2c6-1773aaf6bfbd tempest-ProjectReaderTests-803812786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-43993946-9c62-42f6-aa40-e9733ec01225" returned: 0 in 0.279s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b7090051-dc37-4bbd-a2c6-1773aaf6bfbd tempest-ProjectReaderTests-803812786 None] Lock "cinder-quobyte-43993946-9c62-42f6-aa40-e9733ec01225" released by "delete_volume" :: held 0.693s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-b7090051-dc37-4bbd-a2c6-1773aaf6bfbd tempest-ProjectReaderTests-803812786 None] Created reservations ['3dc7e044-8186-467c-bf58-9718f74f525d', '21ccd1b2-81d9-4025-9c4f-1b4ba89e1789', '3c0dbe56-7470-434f-ba38-9b3d314842dd', '6df30b31-77b5-424e-a8af-e5834e7fa7ca'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b7090051-dc37-4bbd-a2c6-1773aaf6bfbd tempest-ProjectReaderTests-803812786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b7090051-dc37-4bbd-a2c6-1773aaf6bfbd tempest-ProjectReaderTests-803812786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b7090051-dc37-4bbd-a2c6-1773aaf6bfbd tempest-ProjectReaderTests-803812786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b7090051-dc37-4bbd-a2c6-1773aaf6bfbd tempest-ProjectReaderTests-803812786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b7090051-dc37-4bbd-a2c6-1773aaf6bfbd tempest-ProjectReaderTests-803812786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b7090051-dc37-4bbd-a2c6-1773aaf6bfbd tempest-ProjectReaderTests-803812786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:41 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:24:41 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:42 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b7090051-dc37-4bbd-a2c6-1773aaf6bfbd tempest-ProjectReaderTests-803812786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.271s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-b7090051-dc37-4bbd-a2c6-1773aaf6bfbd tempest-ProjectReaderTests-803812786 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:24:42 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b7090051-dc37-4bbd-a2c6-1773aaf6bfbd tempest-ProjectReaderTests-803812786 None] Deleted volume successfully. Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b7090051-dc37-4bbd-a2c6-1773aaf6bfbd tempest-ProjectReaderTests-803812786 None] Lock "cinder-43993946-9c62-42f6-aa40-e9733ec01225-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Flow 'volume_create_manager' (b356bc56-65c5-46fc-8345-54b62329b9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b588e5-9d9e-47ba-82dc-2a324ae02454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b588e5-9d9e-47ba-82dc-2a324ae02454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1000026456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abce7312-9676-46ae-9339-d4a83be0a591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f11562323a4ac4a702a784e8737c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:43Z,use_quota=True,user_id='259083df7aea4031969495e32e56df1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4a5697-f0fb-4134-98d2-9c975e6e23fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4a5697-f0fb-4134-98d2-9c975e6e23fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e345361f-aa70-44e3-bea2-d8b3bf27487e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e345361f-aa70-44e3-bea2-d8b3bf27487e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abce7312-9676-46ae-9339-d4a83be0a591', 'volume_name': 'volume-abce7312-9676-46ae-9339-d4a83be0a591', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff5ecfb-f87f-495a-8521-c3e6815aba11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff5ecfb-f87f-495a-8521-c3e6815aba11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ba61c97-5a3f-4964-a54e-64a0cf852c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:42 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Volume abce7312-9676-46ae-9339-d4a83be0a591: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abce7312-9676-46ae-9339-d4a83be0a591', 'volume_size': 1} Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1000026456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abce7312-9676-46ae-9339-d4a83be0a591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f11562323a4ac4a702a784e8737c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:43Z,use_quota=True,user_id='259083df7aea4031969495e32e56df1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Creating volume abce7312-9676-46ae-9339-d4a83be0a591 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:24:42 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:24:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-abce7312-9676-46ae-9339-d4a83be0a591 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:42 devstack sudo[104149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-abce7312-9676-46ae-9339-d4a83be0a591 1073741824 Jul 22 12:24:42 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:43 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-abce7312-9676-46ae-9339-d4a83be0a591 1073741824" returned: 0 in 0.460s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-abce7312-9676-46ae-9339-d4a83be0a591 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:43 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-abce7312-9676-46ae-9339-d4a83be0a591 Jul 22 12:24:43 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:43 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-abce7312-9676-46ae-9339-d4a83be0a591" returned: 0 in 0.260s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:43 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:24:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ba61c97-5a3f-4964-a54e-64a0cf852c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abce7312-9676-46ae-9339-d4a83be0a591', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bde565b-1b3b-463e-8d6b-0c069c837124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:43 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Volume volume-abce7312-9676-46ae-9339-d4a83be0a591 (abce7312-9676-46ae-9339-d4a83be0a591): created successfully Jul 22 12:24:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bde565b-1b3b-463e-8d6b-0c069c837124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Flow 'volume_create_manager' (b356bc56-65c5-46fc-8345-54b62329b9ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:43 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e71e76cb-1753-425b-bec5-f565524dcd6c tempest-ProjectReaderTests-803812786 None] Created volume successfully. Jul 22 12:24:44 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e17495c8-d7d0-44b6-a6ba-4d23f9007768 tempest-ProjectReaderTests-803812786 None] Acquiring lock "cinder-abce7312-9676-46ae-9339-d4a83be0a591-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:44 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e17495c8-d7d0-44b6-a6ba-4d23f9007768 tempest-ProjectReaderTests-803812786 None] Lock "cinder-abce7312-9676-46ae-9339-d4a83be0a591-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:44 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e17495c8-d7d0-44b6-a6ba-4d23f9007768 tempest-ProjectReaderTests-803812786 None] Acquiring lock "cinder-quobyte-abce7312-9676-46ae-9339-d4a83be0a591" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:44 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e17495c8-d7d0-44b6-a6ba-4d23f9007768 tempest-ProjectReaderTests-803812786 None] Lock "cinder-quobyte-abce7312-9676-46ae-9339-d4a83be0a591" acquired by "delete_volume" :: waited 0.016s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:44 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff5aa78-14cc-40de-8761-03430d970bd3]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e17495c8-d7d0-44b6-a6ba-4d23f9007768 tempest-ProjectReaderTests-803812786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-abce7312-9676-46ae-9339-d4a83be0a591 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:45 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-abce7312-9676-46ae-9339-d4a83be0a591 Jul 22 12:24:45 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:45 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e17495c8-d7d0-44b6-a6ba-4d23f9007768 tempest-ProjectReaderTests-803812786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-abce7312-9676-46ae-9339-d4a83be0a591" returned: 0 in 0.352s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e17495c8-d7d0-44b6-a6ba-4d23f9007768 tempest-ProjectReaderTests-803812786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-abce7312-9676-46ae-9339-d4a83be0a591 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:45 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-abce7312-9676-46ae-9339-d4a83be0a591 Jul 22 12:24:45 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:45 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e17495c8-d7d0-44b6-a6ba-4d23f9007768 tempest-ProjectReaderTests-803812786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-abce7312-9676-46ae-9339-d4a83be0a591" returned: 0 in 0.239s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:45 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e17495c8-d7d0-44b6-a6ba-4d23f9007768 tempest-ProjectReaderTests-803812786 None] Lock "cinder-quobyte-abce7312-9676-46ae-9339-d4a83be0a591" released by "delete_volume" :: held 0.628s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:45 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-e17495c8-d7d0-44b6-a6ba-4d23f9007768 tempest-ProjectReaderTests-803812786 None] Created reservations ['32615d2a-4656-407a-a834-7c2b7fd06efb', 'f0bb38a3-1ec8-4bfd-8e10-df8beab53635', '5196a232-7412-403e-80ef-5472e81d217a', '51017eae-ef06-4b20-ab0c-92a1d5e3e1e0'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:24:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e17495c8-d7d0-44b6-a6ba-4d23f9007768 tempest-ProjectReaderTests-803812786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e17495c8-d7d0-44b6-a6ba-4d23f9007768 tempest-ProjectReaderTests-803812786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e17495c8-d7d0-44b6-a6ba-4d23f9007768 tempest-ProjectReaderTests-803812786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e17495c8-d7d0-44b6-a6ba-4d23f9007768 tempest-ProjectReaderTests-803812786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e17495c8-d7d0-44b6-a6ba-4d23f9007768 tempest-ProjectReaderTests-803812786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e17495c8-d7d0-44b6-a6ba-4d23f9007768 tempest-ProjectReaderTests-803812786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:45 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:24:45 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:45 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e17495c8-d7d0-44b6-a6ba-4d23f9007768 tempest-ProjectReaderTests-803812786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.245s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:45 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-e17495c8-d7d0-44b6-a6ba-4d23f9007768 tempest-ProjectReaderTests-803812786 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:24:45 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e17495c8-d7d0-44b6-a6ba-4d23f9007768 tempest-ProjectReaderTests-803812786 None] Deleted volume successfully. Jul 22 12:24:45 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e17495c8-d7d0-44b6-a6ba-4d23f9007768 tempest-ProjectReaderTests-803812786 None] Lock "cinder-abce7312-9676-46ae-9339-d4a83be0a591-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Flow 'volume_create_manager' (f889dab8-5ddf-49b2-aafc-c517798e3429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3f92ae-3670-4c43-8101-5b5d565f0ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3f92ae-3670-4c43-8101-5b5d565f0ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-645937563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e849e08-f7ce-4e41-a07c-d6683f7ada35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f11562323a4ac4a702a784e8737c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:46Z,use_quota=True,user_id='259083df7aea4031969495e32e56df1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48582ff-cfff-4708-80dd-3546898761c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48582ff-cfff-4708-80dd-3546898761c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85036875-f8c3-478e-82a5-3d52bea17d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85036875-f8c3-478e-82a5-3d52bea17d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e849e08-f7ce-4e41-a07c-d6683f7ada35', 'volume_name': 'volume-1e849e08-f7ce-4e41-a07c-d6683f7ada35', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8cccc21-b7d2-48e8-9c8c-4bd04665fa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8cccc21-b7d2-48e8-9c8c-4bd04665fa7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972d0396-4dcb-4ca7-aae6-01fe6316e32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:46 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Volume 1e849e08-f7ce-4e41-a07c-d6683f7ada35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e849e08-f7ce-4e41-a07c-d6683f7ada35', 'volume_size': 1} Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-645937563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e849e08-f7ce-4e41-a07c-d6683f7ada35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f11562323a4ac4a702a784e8737c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:24:46Z,use_quota=True,user_id='259083df7aea4031969495e32e56df1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Creating volume 1e849e08-f7ce-4e41-a07c-d6683f7ada35 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:24:46 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e849e08-f7ce-4e41-a07c-d6683f7ada35 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:46 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e849e08-f7ce-4e41-a07c-d6683f7ada35 1073741824 Jul 22 12:24:46 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:46 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e849e08-f7ce-4e41-a07c-d6683f7ada35 1073741824" returned: 0 in 0.412s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e849e08-f7ce-4e41-a07c-d6683f7ada35 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:46 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e849e08-f7ce-4e41-a07c-d6683f7ada35 Jul 22 12:24:46 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:47 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e849e08-f7ce-4e41-a07c-d6683f7ada35" returned: 0 in 0.252s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:47 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:24:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972d0396-4dcb-4ca7-aae6-01fe6316e32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e849e08-f7ce-4e41-a07c-d6683f7ada35', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddf5b7c-fc3d-42d7-b4d9-1e4b28c9ba04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:24:47 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Volume volume-1e849e08-f7ce-4e41-a07c-d6683f7ada35 (1e849e08-f7ce-4e41-a07c-d6683f7ada35): created successfully Jul 22 12:24:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddf5b7c-fc3d-42d7-b4d9-1e4b28c9ba04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:24:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Flow 'volume_create_manager' (f889dab8-5ddf-49b2-aafc-c517798e3429) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:24:47 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-589d9318-370e-487b-a56f-457a1af147a8 tempest-ProjectReaderTests-803812786 None] Created volume successfully. Jul 22 12:24:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1b32d9a4-9307-4155-9c0b-12708305d2a6 tempest-ProjectReaderTests-803812786 None] Acquiring lock "cinder-1e849e08-f7ce-4e41-a07c-d6683f7ada35-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1b32d9a4-9307-4155-9c0b-12708305d2a6 tempest-ProjectReaderTests-803812786 None] Lock "cinder-1e849e08-f7ce-4e41-a07c-d6683f7ada35-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1b32d9a4-9307-4155-9c0b-12708305d2a6 tempest-ProjectReaderTests-803812786 None] Acquiring lock "cinder-quobyte-1e849e08-f7ce-4e41-a07c-d6683f7ada35" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:24:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1b32d9a4-9307-4155-9c0b-12708305d2a6 tempest-ProjectReaderTests-803812786 None] Lock "cinder-quobyte-1e849e08-f7ce-4e41-a07c-d6683f7ada35" acquired by "delete_volume" :: waited 0.015s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:24:47 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[442fa4d3-7994-4fd9-bedc-c1bc5e7999ec]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:24:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1b32d9a4-9307-4155-9c0b-12708305d2a6 tempest-ProjectReaderTests-803812786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e849e08-f7ce-4e41-a07c-d6683f7ada35 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:47 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e849e08-f7ce-4e41-a07c-d6683f7ada35 Jul 22 12:24:47 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:47 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1b32d9a4-9307-4155-9c0b-12708305d2a6 tempest-ProjectReaderTests-803812786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e849e08-f7ce-4e41-a07c-d6683f7ada35" returned: 0 in 0.350s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1b32d9a4-9307-4155-9c0b-12708305d2a6 tempest-ProjectReaderTests-803812786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e849e08-f7ce-4e41-a07c-d6683f7ada35 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:47 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e849e08-f7ce-4e41-a07c-d6683f7ada35 Jul 22 12:24:47 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:48 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1b32d9a4-9307-4155-9c0b-12708305d2a6 tempest-ProjectReaderTests-803812786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1e849e08-f7ce-4e41-a07c-d6683f7ada35" returned: 0 in 0.247s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1b32d9a4-9307-4155-9c0b-12708305d2a6 tempest-ProjectReaderTests-803812786 None] Lock "cinder-quobyte-1e849e08-f7ce-4e41-a07c-d6683f7ada35" released by "delete_volume" :: held 0.634s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:48 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-1b32d9a4-9307-4155-9c0b-12708305d2a6 tempest-ProjectReaderTests-803812786 None] Created reservations ['97b96591-7efe-4785-8998-324104323ae6', 'ddf69e00-e9a0-4fa2-ab3e-32c0303e38ec', '8c84fa99-a2d2-4ad9-a24e-4938f9af7cd0', '75de0baf-2465-4699-a36e-16e199ba0443'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:24:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1b32d9a4-9307-4155-9c0b-12708305d2a6 tempest-ProjectReaderTests-803812786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:24:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1b32d9a4-9307-4155-9c0b-12708305d2a6 tempest-ProjectReaderTests-803812786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:24:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1b32d9a4-9307-4155-9c0b-12708305d2a6 tempest-ProjectReaderTests-803812786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:24:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1b32d9a4-9307-4155-9c0b-12708305d2a6 tempest-ProjectReaderTests-803812786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:24:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1b32d9a4-9307-4155-9c0b-12708305d2a6 tempest-ProjectReaderTests-803812786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:24:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1b32d9a4-9307-4155-9c0b-12708305d2a6 tempest-ProjectReaderTests-803812786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:24:48 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:24:48 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:24:48 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Jul 22 12:24:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1b32d9a4-9307-4155-9c0b-12708305d2a6 tempest-ProjectReaderTests-803812786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.240s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:24:48 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-1b32d9a4-9307-4155-9c0b-12708305d2a6 tempest-ProjectReaderTests-803812786 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:24:48 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-1b32d9a4-9307-4155-9c0b-12708305d2a6 tempest-ProjectReaderTests-803812786 None] Deleted volume successfully. Jul 22 12:24:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1b32d9a4-9307-4155-9c0b-12708305d2a6 tempest-ProjectReaderTests-803812786 None] Lock "cinder-1e849e08-f7ce-4e41-a07c-d6683f7ada35-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:24:58 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=109,cinder:INSERT=49,cinder:UPDATE=181,cinder:DELETE=12 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:24:58 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:UPDATE=176,cinder:SELECT=130,cinder:DELETE=19,cinder:INSERT=44 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:25:00 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Flow 'volume_create_manager' (b3cd2bd0-1d5b-451c-9b41-55910d00c9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f380c80b-f8c1-434e-89b3-f5cce5b9b458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f380c80b-f8c1-434e-89b3-f5cce5b9b458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-306627646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e41743c-4ec5-4151-9006-7299349f8137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7acd424fb8ea42488162fd5e2afc7a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:00Z,use_quota=True,user_id='cb1bac418031438ab44af40f664b8f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2377e659-36bf-40d5-9feb-c6161197a000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2377e659-36bf-40d5-9feb-c6161197a000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f21142-e092-4f35-8742-4d41eaf932cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f21142-e092-4f35-8742-4d41eaf932cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e41743c-4ec5-4151-9006-7299349f8137', 'volume_name': 'volume-7e41743c-4ec5-4151-9006-7299349f8137', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d12ac93-236a-443e-9911-452e35a6a3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d12ac93-236a-443e-9911-452e35a6a3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:00 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50bfc6d5-fff2-4c90-95b1-c423f84c95a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:00 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Volume 7e41743c-4ec5-4151-9006-7299349f8137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e41743c-4ec5-4151-9006-7299349f8137', 'volume_size': 1} Jul 22 12:25:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-306627646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e41743c-4ec5-4151-9006-7299349f8137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7acd424fb8ea42488162fd5e2afc7a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:00Z,use_quota=True,user_id='cb1bac418031438ab44af40f664b8f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Creating volume 7e41743c-4ec5-4151-9006-7299349f8137 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:00 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:00 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137 1073741824 Jul 22 12:25:00 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:01 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137 1073741824" returned: 0 in 0.513s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:01 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137 Jul 22 12:25:01 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:01 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137" returned: 0 in 0.413s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50bfc6d5-fff2-4c90-95b1-c423f84c95a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e41743c-4ec5-4151-9006-7299349f8137', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029ff45d-0299-43ad-8b14-723e3ce7475a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:01 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Volume volume-7e41743c-4ec5-4151-9006-7299349f8137 (7e41743c-4ec5-4151-9006-7299349f8137): created successfully Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029ff45d-0299-43ad-8b14-723e3ce7475a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Flow 'volume_create_manager' (b3cd2bd0-1d5b-451c-9b41-55910d00c9a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:01 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-1311b3ed-bcdf-4ba5-beee-25e8880cda10 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Created volume successfully. Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Flow 'volume_create_manager' (0eba1abc-1830-42fa-b399-fad6844086c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0032164b-8560-483d-bec5-ae4a36d39f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0032164b-8560-483d-bec5-ae4a36d39f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-264464559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89707e5757184c76b39c42c3553f59c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:02Z,use_quota=True,user_id='edd7857f9fd44201b44894c8b9b98d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52061d66-9869-441e-bf77-2d411d5cb9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52061d66-9869-441e-bf77-2d411d5cb9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (892b8cab-7828-4b97-bf72-ffef31683e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (892b8cab-7828-4b97-bf72-ffef31683e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b', 'volume_name': 'volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98b06cc-05c2-47a7-8043-7a9bc37885ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98b06cc-05c2-47a7-8043-7a9bc37885ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e223bc-163c-4725-a6e2-c22a678a4aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:01 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Volume a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b', 'volume_size': 1} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-264464559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89707e5757184c76b39c42c3553f59c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:02Z,use_quota=True,user_id='edd7857f9fd44201b44894c8b9b98d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Creating volume a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:01 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:01 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b 1073741824 Jul 22 12:25:01 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:02 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b 1073741824" returned: 0 in 0.525s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:02 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b Jul 22 12:25:02 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:02 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b" returned: 0 in 0.294s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e223bc-163c-4725-a6e2-c22a678a4aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b9db24-633d-43b7-970a-df0f8d708ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:02 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Volume volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b (a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b): created successfully Jul 22 12:25:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b9db24-633d-43b7-970a-df0f8d708ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Flow 'volume_create_manager' (0eba1abc-1830-42fa-b399-fad6844086c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:02 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-de981d39-aaac-433a-a641-4d6b8f7fbbf0 tempest-ProjectMemberTests-872887571 None] Created volume successfully. Jul 22 12:25:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b812fcc5-551a-4d0d-8087-0a4a6e7d62fe tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b812fcc5-551a-4d0d-8087-0a4a6e7d62fe tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-b812fcc5-551a-4d0d-8087-0a4a6e7d62fe tempest-CreateVolumesFromSnapshotTest-1983980424 None] Creating offline snapshot ebe03715-854f-4071-b572-90f1688e063f of volume 7e41743c-4ec5-4151-9006-7299349f8137 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:25:02 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[155eff82-ce7c-444c-bc1b-c57505ebc701]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b812fcc5-551a-4d0d-8087-0a4a6e7d62fe tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:03 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137 Jul 22 12:25:03 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:03 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b812fcc5-551a-4d0d-8087-0a4a6e7d62fe tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137" returned: 0 in 0.422s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b812fcc5-551a-4d0d-8087-0a4a6e7d62fe tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.ebe03715-854f-4071-b572-90f1688e063f 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:03 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.ebe03715-854f-4071-b572-90f1688e063f 1G Jul 22 12:25:03 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:03 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Flow 'volume_create_manager' (f28e1e48-1a19-4481-a948-6085f168a411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb665f8-49ae-4249-be6f-c89a6df814df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb665f8-49ae-4249-be6f-c89a6df814df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4aeb714-7b9e-4a30-85a9-a4d255a9d32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21119896f6d44e6e8b404c81b43b7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:04Z,use_quota=True,user_id='091bbcc4aa0249948b69ce61b01567a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (254c5693-2cf9-4efb-b797-3a57d2f96813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (254c5693-2cf9-4efb-b797-3a57d2f96813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f051c0cb-fc62-4095-9f2c-72f0d37d1ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:03 devstack cinder-volume[87568]: DEBUG cinder.image.glance [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Creating Keystone auth plugin from conf {{(pid=87568) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 12:25:03 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b812fcc5-551a-4d0d-8087-0a4a6e7d62fe tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.ebe03715-854f-4071-b572-90f1688e063f 1G" returned: 0 in 0.558s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b812fcc5-551a-4d0d-8087-0a4a6e7d62fe tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e41743c-4ec5-4151-9006-7299349f8137 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.ebe03715-854f-4071-b572-90f1688e063f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:03 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e41743c-4ec5-4151-9006-7299349f8137 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.ebe03715-854f-4071-b572-90f1688e063f Jul 22 12:25:03 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f051c0cb-fc62-4095-9f2c-72f0d37d1ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e4aeb714-7b9e-4a30-85a9-a4d255a9d32d', 'volume_name': 'volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d', 'volume_size': 1, 'image_id': 'e759d80d-7e93-4caa-aae8-92fcdf873801', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e759d80d-7e93-4caa-aae8-92fcdf873801', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a0b45a90aaa4d081b8462dcf8df96e5a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '21119896f6d44e6e8b404c81b43b7b80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '20173f1f0f97c3f0e7202e7fa111099f4f5daf5c827c01db969d7df0af65dedac0968eb797afbaa73e3c22ca9fef6f6c6d3e19f30157fe27d6e8cdcb497c011b', 'id': 'e759d80d-7e93-4caa-aae8-92fcdf873801', 'created_at': datetime.datetime(2026, 7, 22, 10, 25, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 25, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e759d80d-7e93-4caa-aae8-92fcdf873801/file', 'properties': {}}, 'image_service': }' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b961f8-771e-4626-9aee-8aec663c314f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b961f8-771e-4626-9aee-8aec663c314f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a255b2-37a4-420f-a064-b91cdf574639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:03 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Volume e4aeb714-7b9e-4a30-85a9-a4d255a9d32d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d', 'volume_size': 1, 'image_id': 'e759d80d-7e93-4caa-aae8-92fcdf873801', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e759d80d-7e93-4caa-aae8-92fcdf873801', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a0b45a90aaa4d081b8462dcf8df96e5a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '21119896f6d44e6e8b404c81b43b7b80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '20173f1f0f97c3f0e7202e7fa111099f4f5daf5c827c01db969d7df0af65dedac0968eb797afbaa73e3c22ca9fef6f6c6d3e19f30157fe27d6e8cdcb497c011b', 'id': 'e759d80d-7e93-4caa-aae8-92fcdf873801', 'created_at': datetime.datetime(2026, 7, 22, 10, 25, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 25, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e759d80d-7e93-4caa-aae8-92fcdf873801/file', 'properties': {}}, 'image_service': } Jul 22 12:25:03 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Trying to clone e4aeb714-7b9e-4a30-85a9-a4d255a9d32d from image e759d80d-7e93-4caa-aae8-92fcdf873801 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e759d80d-7e93-4caa-aae8-92fcdf873801', 'metadata': {}}]). {{(pid=87568) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 12:25:04 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 12:25:04 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Image download 0.00 MB at 0.00 MB/s Jul 22 12:25:04 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[91387bcf-72be-4adf-b41c-16672a12f03f]: (4, 'raw') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7185d13b-885b-4b87-86cb-fdcaa7909b27 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:04 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b812fcc5-551a-4d0d-8087-0a4a6e7d62fe tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e41743c-4ec5-4151-9006-7299349f8137 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.ebe03715-854f-4071-b572-90f1688e063f" returned: 0 in 0.488s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:04 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-b812fcc5-551a-4d0d-8087-0a4a6e7d62fe tempest-CreateVolumesFromSnapshotTest-1983980424 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.ebe03715-854f-4071-b572-90f1688e063f is being set with open permissions: ugo+rw Jul 22 12:25:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b812fcc5-551a-4d0d-8087-0a4a6e7d62fe tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.ebe03715-854f-4071-b572-90f1688e063f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:04 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.ebe03715-854f-4071-b572-90f1688e063f Jul 22 12:25:04 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:04 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD Jul 22 12:25:04 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:04 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:04 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b812fcc5-551a-4d0d-8087-0a4a6e7d62fe tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.ebe03715-854f-4071-b572-90f1688e063f" returned: 0 in 0.307s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b812fcc5-551a-4d0d-8087-0a4a6e7d62fe tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:04 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.info Jul 22 12:25:04 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:04 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD Jul 22 12:25:04 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:04 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:04 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Flow 'volume_create_manager' (44123f4e-423a-4133-b22c-eb36d7812da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:04 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02b5597-e259-4b8b-8c50-209c7ec29a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:04 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02b5597-e259-4b8b-8c50-209c7ec29a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfec1bf9-693d-4b87-96b2-5b705661eb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff11064ed51e4d30867b10b39e58e805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:05Z,use_quota=True,user_id='ad7c6c768e4b48f5bcef38d52db5d24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c839919d-8157-45e6-9c5a-d91654d0a5aa),volume_type_id=c839919d-8157-45e6-9c5a-d91654d0a5aa)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:04 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f096042-5c7e-4cf8-87d3-b9f6b71611f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:04 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f096042-5c7e-4cf8-87d3-b9f6b71611f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:04 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4bbf9b8-aa19-4727-8730-31816b68cb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:04 devstack cinder-volume[87568]: DEBUG cinder.image.glance [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Creating Keystone auth plugin from conf {{(pid=87568) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 12:25:05 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD" returned: 1 in 0.343s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Temporary image e759d80d-7e93-4caa-aae8-92fcdf873801 is fetched for user 091bbcc4aa0249948b69ce61b01567a0. {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 12:25:05 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b812fcc5-551a-4d0d-8087-0a4a6e7d62fe tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.info" returned: 0 in 0.293s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:05 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-b812fcc5-551a-4d0d-8087-0a4a6e7d62fe tempest-CreateVolumesFromSnapshotTest-1983980424 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.info is being set with open permissions: ugo+rw Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b812fcc5-551a-4d0d-8087-0a4a6e7d62fe tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:05 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.info Jul 22 12:25:05 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c68998-1bbe-45e2-b0c9-9c566cefe3cc]: (4, 'raw') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4bbf9b8-aa19-4727-8730-31816b68cb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dfec1bf9-693d-4b87-96b2-5b705661eb09', 'volume_name': 'volume-dfec1bf9-693d-4b87-96b2-5b705661eb09', 'volume_size': 1, 'image_id': 'ff8e59e8-fdce-4cdf-88a7-99ee422e44c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff8e59e8-fdce-4cdf-88a7-99ee422e44c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '602534bf5d6c2a1035dafebe5c1f95b2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ff11064ed51e4d30867b10b39e58e805', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4cc54db3ad830304aa01c6cf1560eb9221a4c6882852950ebef02a1b1c64148a1eddf4c031b8beaaa43c64db8d50b8318fa2e2f5ef3779c221f040f292179d09', 'id': 'ff8e59e8-fdce-4cdf-88a7-99ee422e44c5', 'created_at': datetime.datetime(2026, 7, 22, 10, 25, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 25, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff8e59e8-fdce-4cdf-88a7-99ee422e44c5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b700e5dd-d25a-4864-896d-f63bf36dc3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b700e5dd-d25a-4864-896d-f63bf36dc3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a341e4d-86d1-4533-951c-a8d5a7870eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:05 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Volume dfec1bf9-693d-4b87-96b2-5b705661eb09: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dfec1bf9-693d-4b87-96b2-5b705661eb09', 'volume_size': 1, 'image_id': 'ff8e59e8-fdce-4cdf-88a7-99ee422e44c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff8e59e8-fdce-4cdf-88a7-99ee422e44c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '602534bf5d6c2a1035dafebe5c1f95b2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ff11064ed51e4d30867b10b39e58e805', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4cc54db3ad830304aa01c6cf1560eb9221a4c6882852950ebef02a1b1c64148a1eddf4c031b8beaaa43c64db8d50b8318fa2e2f5ef3779c221f040f292179d09', 'id': 'ff8e59e8-fdce-4cdf-88a7-99ee422e44c5', 'created_at': datetime.datetime(2026, 7, 22, 10, 25, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 25, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff8e59e8-fdce-4cdf-88a7-99ee422e44c5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Trying to clone dfec1bf9-693d-4b87-96b2-5b705661eb09 from image ff8e59e8-fdce-4cdf-88a7-99ee422e44c5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ff8e59e8-fdce-4cdf-88a7-99ee422e44c5', 'metadata': {}}]). {{(pid=87568) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 12:25:05 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD Jul 22 12:25:05 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 12:25:05 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Image download 0.00 MB at 0.00 MB/s Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[882b64f3-02e9-4748-9da4-173274e351bb]: (4, 'raw') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:05 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b812fcc5-551a-4d0d-8087-0a4a6e7d62fe tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.info" returned: 0 in 0.284s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b812fcc5-551a-4d0d-8087-0a4a6e7d62fe tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.470s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7185d13b-885b-4b87-86cb-fdcaa7909b27 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.064s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-7185d13b-885b-4b87-86cb-fdcaa7909b27 tempest-ProjectMemberTests-872887571 None] Creating offline snapshot fb21f4dc-5cef-420f-9dd5-fe410893fc7b of volume a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[25553cdf-3078-4be0-a38a-2de2776162ea]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7185d13b-885b-4b87-86cb-fdcaa7909b27 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:05 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b812fcc5-551a-4d0d-8087-0a4a6e7d62fe tempest-CreateVolumesFromSnapshotTest-1983980424 None] Create snapshot completed successfully Jul 22 12:25:05 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD Jul 22 12:25:05 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:05 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:05 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b Jul 22 12:25:05 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:05 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD Jul 22 12:25:05 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:05 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:05 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7185d13b-885b-4b87-86cb-fdcaa7909b27 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b" returned: 0 in 0.400s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7185d13b-885b-4b87-86cb-fdcaa7909b27 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.fb21f4dc-5cef-420f-9dd5-fe410893fc7b 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:05 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD Jul 22 12:25:05 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:05 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.fb21f4dc-5cef-420f-9dd5-fe410893fc7b 1G Jul 22 12:25:05 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:05 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD" returned: 1 in 0.358s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:05 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:25:05 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Temporary image ff8e59e8-fdce-4cdf-88a7-99ee422e44c5 is fetched for user ad7c6c768e4b48f5bcef38d52db5d24e. {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d82b5e-ec77-4464-a901-a2ee97eddfa9]: (4, 'raw') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:06 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7185d13b-885b-4b87-86cb-fdcaa7909b27 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.fb21f4dc-5cef-420f-9dd5-fe410893fc7b 1G" returned: 0 in 0.414s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7185d13b-885b-4b87-86cb-fdcaa7909b27 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.fb21f4dc-5cef-420f-9dd5-fe410893fc7b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:06 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD Jul 22 12:25:06 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:06 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.fb21f4dc-5cef-420f-9dd5-fe410893fc7b Jul 22 12:25:06 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:06 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:06 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7185d13b-885b-4b87-86cb-fdcaa7909b27 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.fb21f4dc-5cef-420f-9dd5-fe410893fc7b" returned: 0 in 0.327s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:06 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-7185d13b-885b-4b87-86cb-fdcaa7909b27 tempest-ProjectMemberTests-872887571 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.fb21f4dc-5cef-420f-9dd5-fe410893fc7b is being set with open permissions: ugo+rw Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7185d13b-885b-4b87-86cb-fdcaa7909b27 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.fb21f4dc-5cef-420f-9dd5-fe410893fc7b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:06 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.fb21f4dc-5cef-420f-9dd5-fe410893fc7b Jul 22 12:25:06 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:06 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD Jul 22 12:25:06 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:06 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD" returned: 1 in 0.376s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:06 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7185d13b-885b-4b87-86cb-fdcaa7909b27 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.fb21f4dc-5cef-420f-9dd5-fe410893fc7b" returned: 0 in 0.321s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7185d13b-885b-4b87-86cb-fdcaa7909b27 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:06 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.info Jul 22 12:25:06 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Flow 'volume_create_manager' (fb3f87a2-dccf-433c-8125-93b19190ffce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d10ed2f-360c-4883-9d79-fbb8e8e100eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d10ed2f-360c-4883-9d79-fbb8e8e100eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-865407140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb25db95-25ad-4a02-95c9-35033d17cbed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7acd424fb8ea42488162fd5e2afc7a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:07Z,use_quota=True,user_id='cb1bac418031438ab44af40f664b8f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1536701b-d5b0-4ce7-a2ce-418d83523052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1536701b-d5b0-4ce7-a2ce-418d83523052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ffdba9-3590-44fc-b99b-83db7b4691b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ffdba9-3590-44fc-b99b-83db7b4691b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb25db95-25ad-4a02-95c9-35033d17cbed', 'volume_name': 'volume-cb25db95-25ad-4a02-95c9-35033d17cbed', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b897f7-999f-4ef4-b272-7248aa6800a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b897f7-999f-4ef4-b272-7248aa6800a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75649c0-ee09-47a7-ad15-af009a3c5a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:07 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Volume cb25db95-25ad-4a02-95c9-35033d17cbed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb25db95-25ad-4a02-95c9-35033d17cbed', 'volume_size': 1} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:07 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7185d13b-885b-4b87-86cb-fdcaa7909b27 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.info" returned: 0 in 0.298s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:07 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-7185d13b-885b-4b87-86cb-fdcaa7909b27 tempest-ProjectMemberTests-872887571 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.info is being set with open permissions: ugo+rw Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7185d13b-885b-4b87-86cb-fdcaa7909b27 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:07 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.info Jul 22 12:25:07 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Flow 'volume_create_manager' (f168c7d2-a063-4b42-963e-6bcfc0bf4769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324ef4df-5ebd-43ee-bf3c-b7584b5499c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324ef4df-5ebd-43ee-bf3c-b7584b5499c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1985179579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e65d886-c320-43c1-b4a0-acd4819c4aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7acd424fb8ea42488162fd5e2afc7a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:07Z,use_quota=True,user_id='cb1bac418031438ab44af40f664b8f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4adc0f38-e506-41b6-b77d-be48743b4182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4adc0f38-e506-41b6-b77d-be48743b4182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2851a47-140d-4793-b329-5a94d0d5f2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2851a47-140d-4793-b329-5a94d0d5f2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e65d886-c320-43c1-b4a0-acd4819c4aa6', 'volume_name': 'volume-3e65d886-c320-43c1-b4a0-acd4819c4aa6', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55fab862-4848-470a-a46a-ea05cac63137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55fab862-4848-470a-a46a-ea05cac63137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (208d5590-871a-4115-abfc-da9f3737b19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:07 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Volume 3e65d886-c320-43c1-b4a0-acd4819c4aa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e65d886-c320-43c1-b4a0-acd4819c4aa6', 'volume_size': 1} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:07 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7185d13b-885b-4b87-86cb-fdcaa7909b27 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.info" returned: 0 in 0.255s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7185d13b-885b-4b87-86cb-fdcaa7909b27 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.133s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.640s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4aeb714-7b9e-4a30-85a9-a4d255a9d32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21119896f6d44e6e8b404c81b43b7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:04Z,use_quota=True,user_id='091bbcc4aa0249948b69ce61b01567a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Creating volume e4aeb714-7b9e-4a30-85a9-a4d255a9d32d {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:07 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:07 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d 1073741824 Jul 22 12:25:07 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:07 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-7185d13b-885b-4b87-86cb-fdcaa7909b27 tempest-ProjectMemberTests-872887571 None] Create snapshot completed successfully Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Flow 'volume_create_manager' (ce7c62d5-cb2c-4077-acfe-f29cecc98119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a29fa8c-1b92-4302-8ad5-d4ffc70ad14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a29fa8c-1b92-4302-8ad5-d4ffc70ad14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-988808720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25620f7-679c-47aa-8afc-16e102da055f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7acd424fb8ea42488162fd5e2afc7a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:08Z,use_quota=True,user_id='cb1bac418031438ab44af40f664b8f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5321d4-c280-43d8-b0bf-97f04d5671c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5321d4-c280-43d8-b0bf-97f04d5671c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d230b8e1-ca93-4567-ab35-76fc77697c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d230b8e1-ca93-4567-ab35-76fc77697c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e25620f7-679c-47aa-8afc-16e102da055f', 'volume_name': 'volume-e25620f7-679c-47aa-8afc-16e102da055f', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99be0072-41a0-45e7-a1e0-390fc1cf2648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99be0072-41a0-45e7-a1e0-390fc1cf2648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29e4630-41b7-422f-95ce-27aea9e7da37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:07 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Volume e25620f7-679c-47aa-8afc-16e102da055f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e25620f7-679c-47aa-8afc-16e102da055f', 'volume_size': 1} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:07 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Flow 'volume_create_manager' (e893404f-9f55-47cc-8dc6-5f53ffbf85b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4318e59-7149-489d-a821-a2404efdef64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d 1073741824" returned: 0 in 0.525s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4318e59-7149-489d-a821-a2404efdef64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-552501608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9816f56-c58d-4f54-84f2-7ef5c1b6b32a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7acd424fb8ea42488162fd5e2afc7a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:08Z,use_quota=True,user_id='cb1bac418031438ab44af40f664b8f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d56935c5-0f6b-428f-8a5a-0c693e80a95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d56935c5-0f6b-428f-8a5a-0c693e80a95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93cad298-2945-4c08-b9e2-210c356caad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93cad298-2945-4c08-b9e2-210c356caad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9816f56-c58d-4f54-84f2-7ef5c1b6b32a', 'volume_name': 'volume-e9816f56-c58d-4f54-84f2-7ef5c1b6b32a', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b988dca7-33e3-47df-9185-2da483a678e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b988dca7-33e3-47df-9185-2da483a678e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60d15f1-d860-49bd-ab1f-3b22d80440f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:08 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Volume e9816f56-c58d-4f54-84f2-7ef5c1b6b32a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9816f56-c58d-4f54-84f2-7ef5c1b6b32a', 'volume_size': 1} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:08 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d Jul 22 12:25:08 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:08 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Flow 'volume_create_manager' (9f558dd9-0964-4c38-952b-9c10b357a441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b816e5d2-d618-464d-966c-47c7b360e4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d" returned: 0 in 0.284s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.548s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfec1bf9-693d-4b87-96b2-5b705661eb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff11064ed51e4d30867b10b39e58e805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:05Z,use_quota=True,user_id='ad7c6c768e4b48f5bcef38d52db5d24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c839919d-8157-45e6-9c5a-d91654d0a5aa),volume_type_id=c839919d-8157-45e6-9c5a-d91654d0a5aa)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Creating volume dfec1bf9-693d-4b87-96b2-5b705661eb09 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:08 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dfec1bf9-693d-4b87-96b2-5b705661eb09 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b816e5d2-d618-464d-966c-47c7b360e4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-918867508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1e3ba6-5708-41b9-880d-bb4a86e28720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7acd424fb8ea42488162fd5e2afc7a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:08Z,use_quota=True,user_id='cb1bac418031438ab44af40f664b8f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54facd56-846c-419d-ba3f-e70d608759ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:08 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dfec1bf9-693d-4b87-96b2-5b705661eb09 1073741824 Jul 22 12:25:08 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54facd56-846c-419d-ba3f-e70d608759ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a752c3-b6b8-47e0-be08-dce66334eefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a752c3-b6b8-47e0-be08-dce66334eefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b1e3ba6-5708-41b9-880d-bb4a86e28720', 'volume_name': 'volume-4b1e3ba6-5708-41b9-880d-bb4a86e28720', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c609d0f-9ef9-44b3-9ad6-2ef0dd10c637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c609d0f-9ef9-44b3-9ad6-2ef0dd10c637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5512deeb-0f37-46f6-be0e-2985afa82b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:08 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Volume 4b1e3ba6-5708-41b9-880d-bb4a86e28720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b1e3ba6-5708-41b9-880d-bb4a86e28720', 'volume_size': 1} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6b0b1da8-4b3f-4f20-a6fc-d20cce9277b5 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-fb21f4dc-5cef-420f-9dd5-fe410893fc7b-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6b0b1da8-4b3f-4f20-a6fc-d20cce9277b5 tempest-ProjectMemberTests-872887571 None] Lock "cinder-fb21f4dc-5cef-420f-9dd5-fe410893fc7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6b0b1da8-4b3f-4f20-a6fc-d20cce9277b5 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Attempting download of e759d80d-7e93-4caa-aae8-92fcdf873801 ((None, [{'url': 'file:///opt/stack/data/glance/images/e759d80d-7e93-4caa-aae8-92fcdf873801', 'metadata': {}}])) to volume e4aeb714-7b9e-4a30-85a9-a4d255a9d32d. {{(pid=87568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6b0b1da8-4b3f-4f20-a6fc-d20cce9277b5 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6b0b1da8-4b3f-4f20-a6fc-d20cce9277b5 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-fb21f4dc-5cef-420f-9dd5-fe410893fc7b" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6b0b1da8-4b3f-4f20-a6fc-d20cce9277b5 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-fb21f4dc-5cef-420f-9dd5-fe410893fc7b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-6b0b1da8-4b3f-4f20-a6fc-d20cce9277b5 tempest-ProjectMemberTests-872887571 None] Deleting offline snapshot fb21f4dc-5cef-420f-9dd5-fe410893fc7b of volume a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-6b0b1da8-4b3f-4f20-a6fc-d20cce9277b5 tempest-ProjectMemberTests-872887571 None] snapshot_file for this snap is: volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.fb21f4dc-5cef-420f-9dd5-fe410893fc7b {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa66f313-d1b1-4251-b40b-3ef0a2ccfa92]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6b0b1da8-4b3f-4f20-a6fc-d20cce9277b5 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.fb21f4dc-5cef-420f-9dd5-fe410893fc7b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40f3c3d-db9f-4dac-a575-9adcc9e2c868]: (4, 'raw') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e759d80d-7e93-4caa-aae8-92fcdf873801_oxh6xmwf {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:08 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.fb21f4dc-5cef-420f-9dd5-fe410893fc7b Jul 22 12:25:08 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:08 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e759d80d-7e93-4caa-aae8-92fcdf873801_oxh6xmwf Jul 22 12:25:08 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:08 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dfec1bf9-693d-4b87-96b2-5b705661eb09 1073741824" returned: 0 in 0.463s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dfec1bf9-693d-4b87-96b2-5b705661eb09 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:08 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dfec1bf9-693d-4b87-96b2-5b705661eb09 Jul 22 12:25:08 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:08 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e759d80d-7e93-4caa-aae8-92fcdf873801_oxh6xmwf" returned: 0 in 0.375s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e759d80d-7e93-4caa-aae8-92fcdf873801_oxh6xmwf {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:08 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6b0b1da8-4b3f-4f20-a6fc-d20cce9277b5 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.fb21f4dc-5cef-420f-9dd5-fe410893fc7b" returned: 0 in 0.420s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-6b0b1da8-4b3f-4f20-a6fc-d20cce9277b5 tempest-ProjectMemberTests-872887571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[362cdb1f-c390-4bbe-94b3-62e22998f247]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6b0b1da8-4b3f-4f20-a6fc-d20cce9277b5 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:09 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e759d80d-7e93-4caa-aae8-92fcdf873801_oxh6xmwf Jul 22 12:25:09 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:09 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b Jul 22 12:25:09 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:09 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dfec1bf9-693d-4b87-96b2-5b705661eb09" returned: 0 in 0.295s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.177s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-865407140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb25db95-25ad-4a02-95c9-35033d17cbed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7acd424fb8ea42488162fd5e2afc7a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:07Z,use_quota=True,user_id='cb1bac418031438ab44af40f664b8f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Creating volume cb25db95-25ad-4a02-95c9-35033d17cbed {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:09 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cb25db95-25ad-4a02-95c9-35033d17cbed 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:09 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cb25db95-25ad-4a02-95c9-35033d17cbed 1073741824 Jul 22 12:25:09 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Attempting download of ff8e59e8-fdce-4cdf-88a7-99ee422e44c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/ff8e59e8-fdce-4cdf-88a7-99ee422e44c5', 'metadata': {}}])) to volume dfec1bf9-693d-4b87-96b2-5b705661eb09. {{(pid=87568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1c6a8a-f8f9-4741-9240-0b8e55acde50]: (4, 'raw') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_gimsr0m1 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:09 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e759d80d-7e93-4caa-aae8-92fcdf873801_oxh6xmwf" returned: 1 in 0.427s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e759d80d-7e93-4caa-aae8-92fcdf873801_oxh6xmwf' failed. Not Retrying. {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcaf4ecd-ef2b-408f-9ca2-64d2d363cbbf]: (4, 'raw') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:09 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6b0b1da8-4b3f-4f20-a6fc-d20cce9277b5 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b" returned: 0 in 0.417s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6b0b1da8-4b3f-4f20-a6fc-d20cce9277b5 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.fb21f4dc-5cef-420f-9dd5-fe410893fc7b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:09 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_gimsr0m1 Jul 22 12:25:09 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:09 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.fb21f4dc-5cef-420f-9dd5-fe410893fc7b Jul 22 12:25:09 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:09 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD Jul 22 12:25:09 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:09 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cb25db95-25ad-4a02-95c9-35033d17cbed 1073741824" returned: 0 in 0.478s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:09 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_gimsr0m1" returned: 0 in 0.384s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_gimsr0m1 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cb25db95-25ad-4a02-95c9-35033d17cbed {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:09 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:09 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cb25db95-25ad-4a02-95c9-35033d17cbed Jul 22 12:25:09 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:09 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_gimsr0m1 Jul 22 12:25:09 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:09 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6b0b1da8-4b3f-4f20-a6fc-d20cce9277b5 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.fb21f4dc-5cef-420f-9dd5-fe410893fc7b" returned: 0 in 0.454s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6b0b1da8-4b3f-4f20-a6fc-d20cce9277b5 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.fb21f4dc-5cef-420f-9dd5-fe410893fc7b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:09 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD Jul 22 12:25:09 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:09 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.fb21f4dc-5cef-420f-9dd5-fe410893fc7b Jul 22 12:25:09 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:10 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cb25db95-25ad-4a02-95c9-35033d17cbed" returned: 0 in 0.289s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.740s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1985179579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e65d886-c320-43c1-b4a0-acd4819c4aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7acd424fb8ea42488162fd5e2afc7a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:07Z,use_quota=True,user_id='cb1bac418031438ab44af40f664b8f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Creating volume 3e65d886-c320-43c1-b4a0-acd4819c4aa6 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:10 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3e65d886-c320-43c1-b4a0-acd4819c4aa6 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:10 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_gimsr0m1" returned: 1 in 0.376s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_gimsr0m1' failed. Not Retrying. {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75649c0-ee09-47a7-ad15-af009a3c5a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb25db95-25ad-4a02-95c9-35033d17cbed', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:10 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3e65d886-c320-43c1-b4a0-acd4819c4aa6 1073741824 Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56053054-ac92-44bc-88ae-6274a065b46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:10 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93bcb2a-4094-432c-b1b5-317c99f10aa3]: (4, 'raw') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:10 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:10 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Volume volume-cb25db95-25ad-4a02-95c9-35033d17cbed (cb25db95-25ad-4a02-95c9-35033d17cbed): created successfully Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56053054-ac92-44bc-88ae-6274a065b46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Flow 'volume_create_manager' (fb3f87a2-dccf-433c-8125-93b19190ffce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD" returned: 1 in 0.404s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] e759d80d-7e93-4caa-aae8-92fcdf873801 was raw, converting to qcow2 {{(pid=87568) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:10 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-6b0b1da8-4b3f-4f20-a6fc-d20cce9277b5 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b.fb21f4dc-5cef-420f-9dd5-fe410893fc7b" returned: 0 in 0.312s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:10 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-6fa5c348-eaba-45dc-ad0b-7272bd2ba1f6 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Created volume successfully. Jul 22 12:25:10 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d Jul 22 12:25:10 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6b0b1da8-4b3f-4f20-a6fc-d20cce9277b5 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-fb21f4dc-5cef-420f-9dd5-fe410893fc7b" released by "_delete_snapshot" :: held 1.763s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6b0b1da8-4b3f-4f20-a6fc-d20cce9277b5 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b" released by "delete_snapshot" :: held 1.803s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:10 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD Jul 22 12:25:10 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-6b0b1da8-4b3f-4f20-a6fc-d20cce9277b5 tempest-ProjectMemberTests-872887571 None] Created reservations ['4b96101d-299b-4433-90e6-e3c6b7f52ad3', '2c6b79f0-fb68-4a6e-83d4-1662442273d0', '0410b2ea-b59b-4846-94f7-fcdd1d7ef8fd', '464486eb-062f-465b-92b1-a5f6aeb3b743'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:10 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-6b0b1da8-4b3f-4f20-a6fc-d20cce9277b5 tempest-ProjectMemberTests-872887571 None] Delete snapshot completed successfully. Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-6b0b1da8-4b3f-4f20-a6fc-d20cce9277b5 tempest-ProjectMemberTests-872887571 None] Lock "cinder-fb21f4dc-5cef-420f-9dd5-fe410893fc7b-delete_snapshot" released by "delete_snapshot" :: held 2.026s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:10 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD" returned: 0 in 0.517s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:10 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-52d4b66c-1760-4683-a7b9-e288978a74f2 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3e65d886-c320-43c1-b4a0-acd4819c4aa6 1073741824" returned: 0 in 0.604s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-52d4b66c-1760-4683-a7b9-e288978a74f2 tempest-ProjectMemberTests-872887571 None] Lock "cinder-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3e65d886-c320-43c1-b4a0-acd4819c4aa6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-52d4b66c-1760-4683-a7b9-e288978a74f2 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:10 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3e65d886-c320-43c1-b4a0-acd4819c4aa6 Jul 22 12:25:10 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-52d4b66c-1760-4683-a7b9-e288978a74f2 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b" acquired by "delete_volume" :: waited 0.022s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:10 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD Jul 22 12:25:10 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74fd59a-9ebe-43c3-8d80-fc598d9df3d5]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-52d4b66c-1760-4683-a7b9-e288978a74f2 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:10 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d" returned: 0 in 0.659s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e759d80d-7e93-4caa-aae8-92fcdf873801_lu08nlgldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:25:10 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Converted 0.00 MB image at 0.00 MB/s Jul 22 12:25:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:10 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d 1G Jul 22 12:25:10 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:10 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b Jul 22 12:25:10 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:11 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD" returned: 1 in 0.418s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] ff8e59e8-fdce-4cdf-88a7-99ee422e44c5 was raw, converting to qcow2 {{(pid=87568) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dfec1bf9-693d-4b87-96b2-5b705661eb09 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:11 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3e65d886-c320-43c1-b4a0-acd4819c4aa6" returned: 0 in 0.340s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.394s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-988808720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25620f7-679c-47aa-8afc-16e102da055f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7acd424fb8ea42488162fd5e2afc7a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:08Z,use_quota=True,user_id='cb1bac418031438ab44af40f664b8f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Creating volume e25620f7-679c-47aa-8afc-16e102da055f {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:11 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e25620f7-679c-47aa-8afc-16e102da055f 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:11 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dfec1bf9-693d-4b87-96b2-5b705661eb09 Jul 22 12:25:11 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:11 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e25620f7-679c-47aa-8afc-16e102da055f 1073741824 Jul 22 12:25:11 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (208d5590-871a-4115-abfc-da9f3737b19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e65d886-c320-43c1-b4a0-acd4819c4aa6', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f65474a-e701-4a9a-8771-dda05dd7a689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:11 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Volume volume-3e65d886-c320-43c1-b4a0-acd4819c4aa6 (3e65d886-c320-43c1-b4a0-acd4819c4aa6): created successfully Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f65474a-e701-4a9a-8771-dda05dd7a689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Flow 'volume_create_manager' (f168c7d2-a063-4b42-963e-6bcfc0bf4769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:11 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-5928c4ea-4029-46f7-b576-3c7bdae89712 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Created volume successfully. Jul 22 12:25:11 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d 1G" returned: 0 in 0.400s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Downloaded image e759d80d-7e93-4caa-aae8-92fcdf873801 ((None, [{'url': 'file:///opt/stack/data/glance/images/e759d80d-7e93-4caa-aae8-92fcdf873801', 'metadata': {}}])) to volume e4aeb714-7b9e-4a30-85a9-a4d255a9d32d successfully. {{(pid=87568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Temporary image e759d80d-7e93-4caa-aae8-92fcdf873801 for user 091bbcc4aa0249948b69ce61b01567a0 is deleted. {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Marking volume e4aeb714-7b9e-4a30-85a9-a4d255a9d32d as bootable. {{(pid=87568) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Copying metadata from image e759d80d-7e93-4caa-aae8-92fcdf873801 to e4aeb714-7b9e-4a30-85a9-a4d255a9d32d. {{(pid=87568) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Creating volume glance metadata for volume e4aeb714-7b9e-4a30-85a9-a4d255a9d32d backed by image e759d80d-7e93-4caa-aae8-92fcdf873801 with: {'image_id': 'e759d80d-7e93-4caa-aae8-92fcdf873801', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a0b45a90aaa4d081b8462dcf8df96e5a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87568) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 12:25:11 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-52d4b66c-1760-4683-a7b9-e288978a74f2 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b" returned: 0 in 0.446s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-52d4b66c-1760-4683-a7b9-e288978a74f2 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:11 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b Jul 22 12:25:11 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a255b2-37a4-420f-a064-b91cdf574639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d', 'volume_size': 1, 'image_id': 'e759d80d-7e93-4caa-aae8-92fcdf873801', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e759d80d-7e93-4caa-aae8-92fcdf873801', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a0b45a90aaa4d081b8462dcf8df96e5a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '21119896f6d44e6e8b404c81b43b7b80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '20173f1f0f97c3f0e7202e7fa111099f4f5daf5c827c01db969d7df0af65dedac0968eb797afbaa73e3c22ca9fef6f6c6d3e19f30157fe27d6e8cdcb497c011b', 'id': 'e759d80d-7e93-4caa-aae8-92fcdf873801', 'created_at': datetime.datetime(2026, 7, 22, 10, 25, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 25, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e759d80d-7e93-4caa-aae8-92fcdf873801/file', 'properties': {}}, 'image_service': }' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da14a091-7d27-46f9-973d-93cc6137c294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:11 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Volume volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d (e4aeb714-7b9e-4a30-85a9-a4d255a9d32d): created successfully Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da14a091-7d27-46f9-973d-93cc6137c294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Flow 'volume_create_manager' (f28e1e48-1a19-4481-a948-6085f168a411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:11 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-859a258b-a3e2-4065-b108-eeebb33167b2 tempest-VolumeImageDependencyTests-1620912207 None] Created volume successfully. Jul 22 12:25:11 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e25620f7-679c-47aa-8afc-16e102da055f 1073741824" returned: 0 in 0.497s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:11 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-52d4b66c-1760-4683-a7b9-e288978a74f2 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b" returned: 0 in 0.318s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-52d4b66c-1760-4683-a7b9-e288978a74f2 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b" released by "delete_volume" :: held 0.841s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:11 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dfec1bf9-693d-4b87-96b2-5b705661eb09" returned: 0 in 0.580s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ff8e59e8-fdce-4cdf-88a7-99ee422e44c5_lrw_tbfudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dfec1bf9-693d-4b87-96b2-5b705661eb09 {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:25:11 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Converted 0.00 MB image at 0.00 MB/s Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dfec1bf9-693d-4b87-96b2-5b705661eb09 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:11 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dfec1bf9-693d-4b87-96b2-5b705661eb09 1G Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e25620f7-679c-47aa-8afc-16e102da055f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:11 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:11 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e25620f7-679c-47aa-8afc-16e102da055f Jul 22 12:25:11 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-52d4b66c-1760-4683-a7b9-e288978a74f2 tempest-ProjectMemberTests-872887571 None] Created reservations ['c1170769-c202-44a9-9dc3-0b1d6fb689ed', '8d322f13-676e-43e7-88db-00a18dce0272', '4be89c75-03ec-474b-8ed8-1e9941d60506', '8370f51f-88eb-4a71-8d99-909dc9e4a10e'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-52d4b66c-1760-4683-a7b9-e288978a74f2 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-52d4b66c-1760-4683-a7b9-e288978a74f2 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-52d4b66c-1760-4683-a7b9-e288978a74f2 tempest-ProjectMemberTests-872887571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-52d4b66c-1760-4683-a7b9-e288978a74f2 tempest-ProjectMemberTests-872887571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-52d4b66c-1760-4683-a7b9-e288978a74f2 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-52d4b66c-1760-4683-a7b9-e288978a74f2 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:11 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:11 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:11 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e25620f7-679c-47aa-8afc-16e102da055f" returned: 0 in 0.274s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.891s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-552501608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9816f56-c58d-4f54-84f2-7ef5c1b6b32a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7acd424fb8ea42488162fd5e2afc7a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:08Z,use_quota=True,user_id='cb1bac418031438ab44af40f664b8f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Creating volume e9816f56-c58d-4f54-84f2-7ef5c1b6b32a {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:11 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e9816f56-c58d-4f54-84f2-7ef5c1b6b32a 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:11 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dfec1bf9-693d-4b87-96b2-5b705661eb09 1G" returned: 0 in 0.350s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Downloaded image ff8e59e8-fdce-4cdf-88a7-99ee422e44c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/ff8e59e8-fdce-4cdf-88a7-99ee422e44c5', 'metadata': {}}])) to volume dfec1bf9-693d-4b87-96b2-5b705661eb09 successfully. {{(pid=87568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Temporary image ff8e59e8-fdce-4cdf-88a7-99ee422e44c5 for user ad7c6c768e4b48f5bcef38d52db5d24e is deleted. {{(pid=87568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 12:25:11 devstack cinder-volume[87568]: DEBUG cinder.volume.volume_utils [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Marking volume dfec1bf9-693d-4b87-96b2-5b705661eb09 as bootable. {{(pid=87568) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 12:25:11 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e9816f56-c58d-4f54-84f2-7ef5c1b6b32a 1073741824 Jul 22 12:25:11 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29e4630-41b7-422f-95ce-27aea9e7da37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e25620f7-679c-47aa-8afc-16e102da055f', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597607db-120e-49ce-a8a7-343ca338d28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Copying metadata from image ff8e59e8-fdce-4cdf-88a7-99ee422e44c5 to dfec1bf9-693d-4b87-96b2-5b705661eb09. {{(pid=87568) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Creating volume glance metadata for volume dfec1bf9-693d-4b87-96b2-5b705661eb09 backed by image ff8e59e8-fdce-4cdf-88a7-99ee422e44c5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ff8e59e8-fdce-4cdf-88a7-99ee422e44c5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '602534bf5d6c2a1035dafebe5c1f95b2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87568) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 12:25:12 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Volume volume-e25620f7-679c-47aa-8afc-16e102da055f (e25620f7-679c-47aa-8afc-16e102da055f): created successfully Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597607db-120e-49ce-a8a7-343ca338d28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Flow 'volume_create_manager' (ce7c62d5-cb2c-4077-acfe-f29cecc98119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:12 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-5c99b562-7709-454a-9404-928e0227b581 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Created volume successfully. Jul 22 12:25:12 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-52d4b66c-1760-4683-a7b9-e288978a74f2 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.278s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-52d4b66c-1760-4683-a7b9-e288978a74f2 tempest-ProjectMemberTests-872887571 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:12 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-52d4b66c-1760-4683-a7b9-e288978a74f2 tempest-ProjectMemberTests-872887571 None] Deleted volume successfully. Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-52d4b66c-1760-4683-a7b9-e288978a74f2 tempest-ProjectMemberTests-872887571 None] Lock "cinder-a9563b6f-d0fe-4b08-8d10-1bfa889c0e3b-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a341e4d-86d1-4533-951c-a8d5a7870eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfec1bf9-693d-4b87-96b2-5b705661eb09', 'volume_size': 1, 'image_id': 'ff8e59e8-fdce-4cdf-88a7-99ee422e44c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff8e59e8-fdce-4cdf-88a7-99ee422e44c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '602534bf5d6c2a1035dafebe5c1f95b2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ff11064ed51e4d30867b10b39e58e805', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4cc54db3ad830304aa01c6cf1560eb9221a4c6882852950ebef02a1b1c64148a1eddf4c031b8beaaa43c64db8d50b8318fa2e2f5ef3779c221f040f292179d09', 'id': 'ff8e59e8-fdce-4cdf-88a7-99ee422e44c5', 'created_at': datetime.datetime(2026, 7, 22, 10, 25, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 10, 25, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff8e59e8-fdce-4cdf-88a7-99ee422e44c5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c249afb-cd2a-4fd1-b841-2aca54e1661d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:12 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Volume volume-dfec1bf9-693d-4b87-96b2-5b705661eb09 (dfec1bf9-693d-4b87-96b2-5b705661eb09): created successfully Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c249afb-cd2a-4fd1-b841-2aca54e1661d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Flow 'volume_create_manager' (44123f4e-423a-4133-b22c-eb36d7812da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:12 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-230f8d9c-34db-4b89-81f8-78f76c1da7c3 tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Created volume successfully. Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8233f66f-43b0-4445-a003-18b0dd717f6a tempest-VolumeImageDependencyTests-1620912207 None] Acquiring lock "cinder-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8233f66f-43b0-4445-a003-18b0dd717f6a tempest-VolumeImageDependencyTests-1620912207 None] Lock "cinder-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8233f66f-43b0-4445-a003-18b0dd717f6a tempest-VolumeImageDependencyTests-1620912207 None] Acquiring lock "cinder-quobyte-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8233f66f-43b0-4445-a003-18b0dd717f6a tempest-VolumeImageDependencyTests-1620912207 None] Lock "cinder-quobyte-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d" acquired by "delete_volume" :: waited 0.016s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80a4f3b-423e-4b89-8cd4-2350a18cb02a]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8233f66f-43b0-4445-a003-18b0dd717f6a tempest-VolumeImageDependencyTests-1620912207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4315d7a3-abfe-460b-a4dd-5c95aed88bbc tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Acquiring lock "cinder-dfec1bf9-693d-4b87-96b2-5b705661eb09-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4315d7a3-abfe-460b-a4dd-5c95aed88bbc tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Lock "cinder-dfec1bf9-693d-4b87-96b2-5b705661eb09-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4315d7a3-abfe-460b-a4dd-5c95aed88bbc tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Acquiring lock "cinder-quobyte-dfec1bf9-693d-4b87-96b2-5b705661eb09" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4315d7a3-abfe-460b-a4dd-5c95aed88bbc tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Lock "cinder-quobyte-dfec1bf9-693d-4b87-96b2-5b705661eb09" acquired by "delete_volume" :: waited 0.014s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:12 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d Jul 22 12:25:12 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1896fb73-e790-473b-a6ca-6d1e43b258c0]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4315d7a3-abfe-460b-a4dd-5c95aed88bbc tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dfec1bf9-693d-4b87-96b2-5b705661eb09 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:12 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e9816f56-c58d-4f54-84f2-7ef5c1b6b32a 1073741824" returned: 0 in 0.600s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e9816f56-c58d-4f54-84f2-7ef5c1b6b32a {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:12 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e9816f56-c58d-4f54-84f2-7ef5c1b6b32a Jul 22 12:25:12 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:12 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dfec1bf9-693d-4b87-96b2-5b705661eb09 Jul 22 12:25:12 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:12 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8233f66f-43b0-4445-a003-18b0dd717f6a tempest-VolumeImageDependencyTests-1620912207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d" returned: 0 in 0.450s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8233f66f-43b0-4445-a003-18b0dd717f6a tempest-VolumeImageDependencyTests-1620912207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:12 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d Jul 22 12:25:12 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:12 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e9816f56-c58d-4f54-84f2-7ef5c1b6b32a" returned: 0 in 0.297s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.464s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-918867508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1e3ba6-5708-41b9-880d-bb4a86e28720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7acd424fb8ea42488162fd5e2afc7a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:08Z,use_quota=True,user_id='cb1bac418031438ab44af40f664b8f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Creating volume 4b1e3ba6-5708-41b9-880d-bb4a86e28720 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:12 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b1e3ba6-5708-41b9-880d-bb4a86e28720 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:12 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:12 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b1e3ba6-5708-41b9-880d-bb4a86e28720 1073741824 Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60d15f1-d860-49bd-ab1f-3b22d80440f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9816f56-c58d-4f54-84f2-7ef5c1b6b32a', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:12 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2563e7-d8c6-47b5-add7-fd9fcbfc79bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4315d7a3-abfe-460b-a4dd-5c95aed88bbc tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dfec1bf9-693d-4b87-96b2-5b705661eb09" returned: 0 in 0.454s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4315d7a3-abfe-460b-a4dd-5c95aed88bbc tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dfec1bf9-693d-4b87-96b2-5b705661eb09 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:13 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Volume volume-e9816f56-c58d-4f54-84f2-7ef5c1b6b32a (e9816f56-c58d-4f54-84f2-7ef5c1b6b32a): created successfully Jul 22 12:25:13 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dfec1bf9-693d-4b87-96b2-5b705661eb09 Jul 22 12:25:13 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2563e7-d8c6-47b5-add7-fd9fcbfc79bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Flow 'volume_create_manager' (e893404f-9f55-47cc-8dc6-5f53ffbf85b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:13 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-162d3200-48d8-4ba0-a204-42e82608345c tempest-CreateVolumesFromSnapshotTest-1983980424 None] Created volume successfully. Jul 22 12:25:13 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8233f66f-43b0-4445-a003-18b0dd717f6a tempest-VolumeImageDependencyTests-1620912207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d" returned: 0 in 0.333s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8233f66f-43b0-4445-a003-18b0dd717f6a tempest-VolumeImageDependencyTests-1620912207 None] Lock "cinder-quobyte-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d" released by "delete_volume" :: held 0.839s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-8233f66f-43b0-4445-a003-18b0dd717f6a tempest-VolumeImageDependencyTests-1620912207 None] Created reservations ['b5b3610e-af5c-4950-aade-7e8c7dc94ae9', '9c0c79d4-fb2d-42e2-b9ba-af160a187589', '0897ea45-936c-4524-a303-11dda66bfc3e', 'aac57be1-938f-4710-bf21-4386639d61f8'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:13 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8233f66f-43b0-4445-a003-18b0dd717f6a tempest-VolumeImageDependencyTests-1620912207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8233f66f-43b0-4445-a003-18b0dd717f6a tempest-VolumeImageDependencyTests-1620912207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8233f66f-43b0-4445-a003-18b0dd717f6a tempest-VolumeImageDependencyTests-1620912207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8233f66f-43b0-4445-a003-18b0dd717f6a tempest-VolumeImageDependencyTests-1620912207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8233f66f-43b0-4445-a003-18b0dd717f6a tempest-VolumeImageDependencyTests-1620912207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8233f66f-43b0-4445-a003-18b0dd717f6a tempest-VolumeImageDependencyTests-1620912207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4315d7a3-abfe-460b-a4dd-5c95aed88bbc tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-dfec1bf9-693d-4b87-96b2-5b705661eb09" returned: 0 in 0.391s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:13 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:13 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4315d7a3-abfe-460b-a4dd-5c95aed88bbc tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Lock "cinder-quobyte-dfec1bf9-693d-4b87-96b2-5b705661eb09" released by "delete_volume" :: held 0.905s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-4315d7a3-abfe-460b-a4dd-5c95aed88bbc tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Created reservations ['64550e18-6b85-4b9f-97cb-cbb5f29166ea', '021cb63b-8d08-4bdf-aabf-715a6197d479', 'b18a4660-7487-4edf-8c16-3b4687bbad7e', 'b52c2452-d507-4083-a938-d23cfff0248a'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:13 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Flow 'volume_create_manager' (bf89686d-8a48-4c74-ad56-4248e4aa46e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2696248a-5650-4bfc-af1d-2fefbd9bbb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b1e3ba6-5708-41b9-880d-bb4a86e28720 1073741824" returned: 0 in 0.648s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:13 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2696248a-5650-4bfc-af1d-2fefbd9bbb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-629302173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89707e5757184c76b39c42c3553f59c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:13Z,use_quota=True,user_id='edd7857f9fd44201b44894c8b9b98d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9bc183-ae2b-4c4c-9ab0-0d919cf59e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9bc183-ae2b-4c4c-9ab0-0d919cf59e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e769c6-c8cb-4c2e-b121-7af4659a0ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e769c6-c8cb-4c2e-b121-7af4659a0ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6', 'volume_name': 'volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30dccc4b-8735-4fb9-91ea-11d9f6a27798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30dccc4b-8735-4fb9-91ea-11d9f6a27798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c5e2db-d2c7-47c7-bf47-647843770627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:13 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Volume 2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6', 'volume_size': 1} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8233f66f-43b0-4445-a003-18b0dd717f6a tempest-VolumeImageDependencyTests-1620912207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.334s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-8233f66f-43b0-4445-a003-18b0dd717f6a tempest-VolumeImageDependencyTests-1620912207 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:13 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-8233f66f-43b0-4445-a003-18b0dd717f6a tempest-VolumeImageDependencyTests-1620912207 None] Deleted volume successfully. Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b1e3ba6-5708-41b9-880d-bb4a86e28720 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8233f66f-43b0-4445-a003-18b0dd717f6a tempest-VolumeImageDependencyTests-1620912207 None] Lock "cinder-e4aeb714-7b9e-4a30-85a9-a4d255a9d32d-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:13 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b1e3ba6-5708-41b9-880d-bb4a86e28720 Jul 22 12:25:13 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4315d7a3-abfe-460b-a4dd-5c95aed88bbc tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4315d7a3-abfe-460b-a4dd-5c95aed88bbc tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4315d7a3-abfe-460b-a4dd-5c95aed88bbc tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4315d7a3-abfe-460b-a4dd-5c95aed88bbc tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4315d7a3-abfe-460b-a4dd-5c95aed88bbc tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4315d7a3-abfe-460b-a4dd-5c95aed88bbc tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:13 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:13 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:13 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b1e3ba6-5708-41b9-880d-bb4a86e28720" returned: 0 in 0.262s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.313s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-629302173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89707e5757184c76b39c42c3553f59c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:13Z,use_quota=True,user_id='edd7857f9fd44201b44894c8b9b98d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Creating volume 2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:14 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5512deeb-0f37-46f6-be0e-2985afa82b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b1e3ba6-5708-41b9-880d-bb4a86e28720', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:14 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9efd79a9-1bdb-46d4-8b4b-defe10a54eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:14 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6 1073741824 Jul 22 12:25:14 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4315d7a3-abfe-460b-a4dd-5c95aed88bbc tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.281s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:14 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-4315d7a3-abfe-460b-a4dd-5c95aed88bbc tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:14 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Volume volume-4b1e3ba6-5708-41b9-880d-bb4a86e28720 (4b1e3ba6-5708-41b9-880d-bb4a86e28720): created successfully Jul 22 12:25:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9efd79a9-1bdb-46d4-8b4b-defe10a54eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Flow 'volume_create_manager' (9f558dd9-0964-4c38-952b-9c10b357a441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:14 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-4315d7a3-abfe-460b-a4dd-5c95aed88bbc tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Deleted volume successfully. Jul 22 12:25:14 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-3d359bbd-16f3-495b-8c21-7f282ead34b7 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Created volume successfully. Jul 22 12:25:14 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-4315d7a3-abfe-460b-a4dd-5c95aed88bbc tempest-VolumeAndVolumeTypeFromImageTest-761089226 None] Lock "cinder-dfec1bf9-693d-4b87-96b2-5b705661eb09-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:14 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6 1073741824" returned: 0 in 0.485s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:14 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6 Jul 22 12:25:14 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:14 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6" returned: 0 in 0.291s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c5e2db-d2c7-47c7-bf47-647843770627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be845a58-96a5-48fe-a383-45eb0d6e7a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:14 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Volume volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6 (2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6): created successfully Jul 22 12:25:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be845a58-96a5-48fe-a383-45eb0d6e7a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Flow 'volume_create_manager' (bf89686d-8a48-4c74-ad56-4248e4aa46e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:14 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-dbda3f62-88fe-48e0-b355-2f1abd70d7f0 tempest-ProjectMemberTests-872887571 None] Created volume successfully. Jul 22 12:25:15 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3a796a47-e4dc-4be1-b25b-e0809a82031d tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "cinder-4b1e3ba6-5708-41b9-880d-bb4a86e28720-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:15 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3a796a47-e4dc-4be1-b25b-e0809a82031d tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-4b1e3ba6-5708-41b9-880d-bb4a86e28720-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:15 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3a796a47-e4dc-4be1-b25b-e0809a82031d tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "cinder-quobyte-4b1e3ba6-5708-41b9-880d-bb4a86e28720" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:15 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3a796a47-e4dc-4be1-b25b-e0809a82031d tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-quobyte-4b1e3ba6-5708-41b9-880d-bb4a86e28720" acquired by "delete_volume" :: waited 0.020s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:15 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d4a4bd-dd67-4de7-8b8f-36479be0680c]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3a796a47-e4dc-4be1-b25b-e0809a82031d tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b1e3ba6-5708-41b9-880d-bb4a86e28720 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:15 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b1e3ba6-5708-41b9-880d-bb4a86e28720 Jul 22 12:25:15 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aee53051-8993-46ea-a668-f5f445683d59 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aee53051-8993-46ea-a668-f5f445683d59 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:15 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3a796a47-e4dc-4be1-b25b-e0809a82031d tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b1e3ba6-5708-41b9-880d-bb4a86e28720" returned: 0 in 0.494s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3a796a47-e4dc-4be1-b25b-e0809a82031d tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b1e3ba6-5708-41b9-880d-bb4a86e28720 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:15 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-aee53051-8993-46ea-a668-f5f445683d59 tempest-ProjectMemberTests-872887571 None] Creating offline snapshot 801a79d2-6ba6-40cd-b942-9e634e0d01b7 of volume 2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:25:15 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b1e3ba6-5708-41b9-880d-bb4a86e28720 Jul 22 12:25:15 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:15 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1564ad-6bfe-4a30-a339-243994f07029]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aee53051-8993-46ea-a668-f5f445683d59 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:15 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6 Jul 22 12:25:15 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:16 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3a796a47-e4dc-4be1-b25b-e0809a82031d tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4b1e3ba6-5708-41b9-880d-bb4a86e28720" returned: 0 in 0.314s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3a796a47-e4dc-4be1-b25b-e0809a82031d tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-quobyte-4b1e3ba6-5708-41b9-880d-bb4a86e28720" released by "delete_volume" :: held 0.877s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:16 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-3a796a47-e4dc-4be1-b25b-e0809a82031d tempest-CreateVolumesFromSnapshotTest-1983980424 None] Created reservations ['7347440e-3c3d-4b12-ba52-3d1fcb69dcf3', 'f886f6a7-23a2-439e-9de7-8a0b52a3632c', '88429a87-f669-4380-b4b2-88fcc89fc6aa', 'ca3c01f0-f8be-42cd-8411-f641681a617c'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:16 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aee53051-8993-46ea-a668-f5f445683d59 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6" returned: 0 in 0.485s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aee53051-8993-46ea-a668-f5f445683d59 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.801a79d2-6ba6-40cd-b942-9e634e0d01b7 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:16 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.801a79d2-6ba6-40cd-b942-9e634e0d01b7 1G Jul 22 12:25:16 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3a796a47-e4dc-4be1-b25b-e0809a82031d tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3a796a47-e4dc-4be1-b25b-e0809a82031d tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3a796a47-e4dc-4be1-b25b-e0809a82031d tempest-CreateVolumesFromSnapshotTest-1983980424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3a796a47-e4dc-4be1-b25b-e0809a82031d tempest-CreateVolumesFromSnapshotTest-1983980424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3a796a47-e4dc-4be1-b25b-e0809a82031d tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3a796a47-e4dc-4be1-b25b-e0809a82031d tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:16 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:16 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:16 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3a796a47-e4dc-4be1-b25b-e0809a82031d tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.332s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:16 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-3a796a47-e4dc-4be1-b25b-e0809a82031d tempest-CreateVolumesFromSnapshotTest-1983980424 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:16 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-3a796a47-e4dc-4be1-b25b-e0809a82031d tempest-CreateVolumesFromSnapshotTest-1983980424 None] Deleted volume successfully. Jul 22 12:25:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3a796a47-e4dc-4be1-b25b-e0809a82031d tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-4b1e3ba6-5708-41b9-880d-bb4a86e28720-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:16 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aee53051-8993-46ea-a668-f5f445683d59 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.801a79d2-6ba6-40cd-b942-9e634e0d01b7 1G" returned: 0 in 0.480s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aee53051-8993-46ea-a668-f5f445683d59 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.801a79d2-6ba6-40cd-b942-9e634e0d01b7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:16 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.801a79d2-6ba6-40cd-b942-9e634e0d01b7 Jul 22 12:25:16 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:17 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aee53051-8993-46ea-a668-f5f445683d59 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.801a79d2-6ba6-40cd-b942-9e634e0d01b7" returned: 0 in 0.349s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:17 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-aee53051-8993-46ea-a668-f5f445683d59 tempest-ProjectMemberTests-872887571 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.801a79d2-6ba6-40cd-b942-9e634e0d01b7 is being set with open permissions: ugo+rw Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aee53051-8993-46ea-a668-f5f445683d59 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.801a79d2-6ba6-40cd-b942-9e634e0d01b7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:17 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.801a79d2-6ba6-40cd-b942-9e634e0d01b7 Jul 22 12:25:17 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Flow 'volume_create_manager' (e35001ce-b077-49c5-a1c7-1ca774adba33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3259765d-d6e6-4214-8e20-dff8141db20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-314d4fc8-d375-420f-87c6-1ef49e66f201 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "cinder-e9816f56-c58d-4f54-84f2-7ef5c1b6b32a-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3259765d-d6e6-4214-8e20-dff8141db20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d77cade-da5f-4267-ab56-63dac9a15808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='861c28948bfc42b48e8ff1ee71766005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:17Z,use_quota=True,user_id='7fd78d3c699848d4ab05b7404edbc5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f873feb-b48c-47d7-a9c9-6017e8759727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f873feb-b48c-47d7-a9c9-6017e8759727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ccf7be5-3f70-4c1f-a5bc-d51e070e83f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:17 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ccf7be5-3f70-4c1f-a5bc-d51e070e83f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d77cade-da5f-4267-ab56-63dac9a15808', 'volume_name': 'volume-9d77cade-da5f-4267-ab56-63dac9a15808', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3242cc92-ac99-435e-9f1f-62012c075ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3242cc92-ac99-435e-9f1f-62012c075ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dab2178-32d3-476d-bfab-a48148d2cff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:17 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Volume 9d77cade-da5f-4267-ab56-63dac9a15808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d77cade-da5f-4267-ab56-63dac9a15808', 'volume_size': 1} Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-314d4fc8-d375-420f-87c6-1ef49e66f201 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-e9816f56-c58d-4f54-84f2-7ef5c1b6b32a-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aee53051-8993-46ea-a668-f5f445683d59 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.801a79d2-6ba6-40cd-b942-9e634e0d01b7" returned: 0 in 0.414s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aee53051-8993-46ea-a668-f5f445683d59 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:17 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.info Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-314d4fc8-d375-420f-87c6-1ef49e66f201 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "cinder-quobyte-e9816f56-c58d-4f54-84f2-7ef5c1b6b32a" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:17 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-314d4fc8-d375-420f-87c6-1ef49e66f201 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-quobyte-e9816f56-c58d-4f54-84f2-7ef5c1b6b32a" acquired by "delete_volume" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[192f73e3-7631-4bca-9506-6ddb560b4e89]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-314d4fc8-d375-420f-87c6-1ef49e66f201 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e9816f56-c58d-4f54-84f2-7ef5c1b6b32a {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:17 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e9816f56-c58d-4f54-84f2-7ef5c1b6b32a Jul 22 12:25:17 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:17 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aee53051-8993-46ea-a668-f5f445683d59 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.info" returned: 0 in 0.300s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:17 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-aee53051-8993-46ea-a668-f5f445683d59 tempest-ProjectMemberTests-872887571 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.info is being set with open permissions: ugo+rw Jul 22 12:25:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aee53051-8993-46ea-a668-f5f445683d59 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:17 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.info Jul 22 12:25:17 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:18 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-314d4fc8-d375-420f-87c6-1ef49e66f201 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e9816f56-c58d-4f54-84f2-7ef5c1b6b32a" returned: 0 in 0.417s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-314d4fc8-d375-420f-87c6-1ef49e66f201 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e9816f56-c58d-4f54-84f2-7ef5c1b6b32a {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:18 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e9816f56-c58d-4f54-84f2-7ef5c1b6b32a Jul 22 12:25:18 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:18 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aee53051-8993-46ea-a668-f5f445683d59 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.info" returned: 0 in 0.276s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aee53051-8993-46ea-a668-f5f445683d59 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.421s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.643s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d77cade-da5f-4267-ab56-63dac9a15808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='861c28948bfc42b48e8ff1ee71766005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:17Z,use_quota=True,user_id='7fd78d3c699848d4ab05b7404edbc5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Creating volume 9d77cade-da5f-4267-ab56-63dac9a15808 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:18 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d77cade-da5f-4267-ab56-63dac9a15808 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:18 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d77cade-da5f-4267-ab56-63dac9a15808 1073741824 Jul 22 12:25:18 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:18 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-aee53051-8993-46ea-a668-f5f445683d59 tempest-ProjectMemberTests-872887571 None] Create snapshot completed successfully Jul 22 12:25:18 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-314d4fc8-d375-420f-87c6-1ef49e66f201 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e9816f56-c58d-4f54-84f2-7ef5c1b6b32a" returned: 0 in 0.296s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-314d4fc8-d375-420f-87c6-1ef49e66f201 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-quobyte-e9816f56-c58d-4f54-84f2-7ef5c1b6b32a" released by "delete_volume" :: held 0.763s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-314d4fc8-d375-420f-87c6-1ef49e66f201 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Created reservations ['9930ba27-8acc-4423-b418-06010df316f9', '55575cc9-2600-4136-b110-13f30500ea1f', '8817c664-cb89-43ea-b7fe-488583d8da4b', '8f776d81-e2d7-4f22-9280-0ae0ef2be16b'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-314d4fc8-d375-420f-87c6-1ef49e66f201 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-314d4fc8-d375-420f-87c6-1ef49e66f201 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-314d4fc8-d375-420f-87c6-1ef49e66f201 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-314d4fc8-d375-420f-87c6-1ef49e66f201 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-314d4fc8-d375-420f-87c6-1ef49e66f201 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-314d4fc8-d375-420f-87c6-1ef49e66f201 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:18 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:18 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d70c1a17-acf8-42ed-a093-dd8f74f8c59a tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "cinder-e25620f7-679c-47aa-8afc-16e102da055f-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d70c1a17-acf8-42ed-a093-dd8f74f8c59a tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-e25620f7-679c-47aa-8afc-16e102da055f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d70c1a17-acf8-42ed-a093-dd8f74f8c59a tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "cinder-quobyte-e25620f7-679c-47aa-8afc-16e102da055f" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d70c1a17-acf8-42ed-a093-dd8f74f8c59a tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-quobyte-e25620f7-679c-47aa-8afc-16e102da055f" acquired by "delete_volume" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:18 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d77cade-da5f-4267-ab56-63dac9a15808 1073741824" returned: 0 in 0.595s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8a1c74-a10a-4bb3-a659-b98f537f39a5]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d70c1a17-acf8-42ed-a093-dd8f74f8c59a tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e25620f7-679c-47aa-8afc-16e102da055f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:18 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-314d4fc8-d375-420f-87c6-1ef49e66f201 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.344s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-314d4fc8-d375-420f-87c6-1ef49e66f201 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d77cade-da5f-4267-ab56-63dac9a15808 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:18 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-314d4fc8-d375-420f-87c6-1ef49e66f201 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Deleted volume successfully. Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-314d4fc8-d375-420f-87c6-1ef49e66f201 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-e9816f56-c58d-4f54-84f2-7ef5c1b6b32a-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:18 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d77cade-da5f-4267-ab56-63dac9a15808 Jul 22 12:25:18 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:18 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7bd988e6-2469-4cc6-aa3a-6efacb67ddc7 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-801a79d2-6ba6-40cd-b942-9e634e0d01b7-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:18 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e25620f7-679c-47aa-8afc-16e102da055f Jul 22 12:25:18 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7bd988e6-2469-4cc6-aa3a-6efacb67ddc7 tempest-ProjectMemberTests-872887571 None] Lock "cinder-801a79d2-6ba6-40cd-b942-9e634e0d01b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7bd988e6-2469-4cc6-aa3a-6efacb67ddc7 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7bd988e6-2469-4cc6-aa3a-6efacb67ddc7 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7bd988e6-2469-4cc6-aa3a-6efacb67ddc7 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-801a79d2-6ba6-40cd-b942-9e634e0d01b7" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7bd988e6-2469-4cc6-aa3a-6efacb67ddc7 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-801a79d2-6ba6-40cd-b942-9e634e0d01b7" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-7bd988e6-2469-4cc6-aa3a-6efacb67ddc7 tempest-ProjectMemberTests-872887571 None] Deleting offline snapshot 801a79d2-6ba6-40cd-b942-9e634e0d01b7 of volume 2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-7bd988e6-2469-4cc6-aa3a-6efacb67ddc7 tempest-ProjectMemberTests-872887571 None] snapshot_file for this snap is: volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.801a79d2-6ba6-40cd-b942-9e634e0d01b7 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[0511d18e-872b-4609-90b4-0203fe61eb1a]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7bd988e6-2469-4cc6-aa3a-6efacb67ddc7 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.801a79d2-6ba6-40cd-b942-9e634e0d01b7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:19 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.801a79d2-6ba6-40cd-b942-9e634e0d01b7 Jul 22 12:25:19 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:19 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d77cade-da5f-4267-ab56-63dac9a15808" returned: 0 in 0.392s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dab2178-32d3-476d-bfab-a48148d2cff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d77cade-da5f-4267-ab56-63dac9a15808', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2940f3b5-d746-47eb-a2f1-54c8898d90ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:19 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Volume volume-9d77cade-da5f-4267-ab56-63dac9a15808 (9d77cade-da5f-4267-ab56-63dac9a15808): created successfully Jul 22 12:25:19 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2940f3b5-d746-47eb-a2f1-54c8898d90ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Flow 'volume_create_manager' (e35001ce-b077-49c5-a1c7-1ca774adba33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d70c1a17-acf8-42ed-a093-dd8f74f8c59a tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e25620f7-679c-47aa-8afc-16e102da055f" returned: 0 in 0.515s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d70c1a17-acf8-42ed-a093-dd8f74f8c59a tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e25620f7-679c-47aa-8afc-16e102da055f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:19 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-909fb8da-b64e-449b-8136-0cb3ae4cea90 tempest-CinderUnicodeTest-911555230 None] Created volume successfully. Jul 22 12:25:19 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e25620f7-679c-47aa-8afc-16e102da055f Jul 22 12:25:19 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:19 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7bd988e6-2469-4cc6-aa3a-6efacb67ddc7 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.801a79d2-6ba6-40cd-b942-9e634e0d01b7" returned: 0 in 0.472s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-7bd988e6-2469-4cc6-aa3a-6efacb67ddc7 tempest-ProjectMemberTests-872887571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bd919b-354d-4490-abde-fd86355ee33e]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7bd988e6-2469-4cc6-aa3a-6efacb67ddc7 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:19 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d70c1a17-acf8-42ed-a093-dd8f74f8c59a tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e25620f7-679c-47aa-8afc-16e102da055f" returned: 0 in 0.343s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d70c1a17-acf8-42ed-a093-dd8f74f8c59a tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-quobyte-e25620f7-679c-47aa-8afc-16e102da055f" released by "delete_volume" :: held 0.912s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-d70c1a17-acf8-42ed-a093-dd8f74f8c59a tempest-CreateVolumesFromSnapshotTest-1983980424 None] Created reservations ['ab45e924-de89-46b5-beb0-1679867f59ea', '967b5cb0-c472-4698-961e-29760a0caed3', 'a3de8850-8513-4dd0-8db0-7b2c45c18d85', '943cb874-4cb8-4094-8eac-bee045164e96'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:19 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6 Jul 22 12:25:19 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d70c1a17-acf8-42ed-a093-dd8f74f8c59a tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d70c1a17-acf8-42ed-a093-dd8f74f8c59a tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d70c1a17-acf8-42ed-a093-dd8f74f8c59a tempest-CreateVolumesFromSnapshotTest-1983980424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d70c1a17-acf8-42ed-a093-dd8f74f8c59a tempest-CreateVolumesFromSnapshotTest-1983980424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d70c1a17-acf8-42ed-a093-dd8f74f8c59a tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d70c1a17-acf8-42ed-a093-dd8f74f8c59a tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:19 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:19 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b20e6c93-af8b-4308-bab7-6b261fbaac23 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "cinder-3e65d886-c320-43c1-b4a0-acd4819c4aa6-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b20e6c93-af8b-4308-bab7-6b261fbaac23 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-3e65d886-c320-43c1-b4a0-acd4819c4aa6-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b20e6c93-af8b-4308-bab7-6b261fbaac23 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "cinder-quobyte-3e65d886-c320-43c1-b4a0-acd4819c4aa6" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b20e6c93-af8b-4308-bab7-6b261fbaac23 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-quobyte-3e65d886-c320-43c1-b4a0-acd4819c4aa6" acquired by "delete_volume" :: waited 0.033s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[af44b0b5-e54a-4d85-ae2f-9e13006298ae]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b20e6c93-af8b-4308-bab7-6b261fbaac23 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3e65d886-c320-43c1-b4a0-acd4819c4aa6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:20 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7bd988e6-2469-4cc6-aa3a-6efacb67ddc7 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6" returned: 0 in 0.637s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7bd988e6-2469-4cc6-aa3a-6efacb67ddc7 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.801a79d2-6ba6-40cd-b942-9e634e0d01b7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:20 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.801a79d2-6ba6-40cd-b942-9e634e0d01b7 Jul 22 12:25:20 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:20 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d70c1a17-acf8-42ed-a093-dd8f74f8c59a tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.497s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-d70c1a17-acf8-42ed-a093-dd8f74f8c59a tempest-CreateVolumesFromSnapshotTest-1983980424 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Flow 'volume_create_manager' (8bc9e96c-2b01-43ae-9351-6d64d897c7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777f6798-1934-445f-86cc-ec1fca0f0616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:20 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d70c1a17-acf8-42ed-a093-dd8f74f8c59a tempest-CreateVolumesFromSnapshotTest-1983980424 None] Deleted volume successfully. Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777f6798-1934-445f-86cc-ec1fca0f0616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1871084630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9d7b43f3b349c5bff6d4542a593693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:20Z,use_quota=True,user_id='70f2aff194fd45b0a4ef7b570b78d6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d01fa9-3100-4141-8373-9b67ca76172b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d01fa9-3100-4141-8373-9b67ca76172b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a23db5c-dce6-483b-b9cd-8659f5d2cc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:20 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3e65d886-c320-43c1-b4a0-acd4819c4aa6 Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a23db5c-dce6-483b-b9cd-8659f5d2cc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0', 'volume_name': 'volume-a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:20 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (673cce65-f94a-4000-aa01-6f9822f8b33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (673cce65-f94a-4000-aa01-6f9822f8b33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c95b33-3330-4f6d-b23d-f3fb9963f33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:20 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Volume a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0', 'volume_size': 1} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1871084630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9d7b43f3b349c5bff6d4542a593693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:20Z,use_quota=True,user_id='70f2aff194fd45b0a4ef7b570b78d6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Creating volume a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:20 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d70c1a17-acf8-42ed-a093-dd8f74f8c59a tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-e25620f7-679c-47aa-8afc-16e102da055f-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:20 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0 1073741824 Jul 22 12:25:20 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Flow 'volume_create_manager' (21e3310f-301c-4e6d-bba1-16faa248f9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75803b6e-afa3-4f67-97b5-f3ae8f255e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:20 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:20 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b20e6c93-af8b-4308-bab7-6b261fbaac23 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3e65d886-c320-43c1-b4a0-acd4819c4aa6" returned: 0 in 0.614s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b20e6c93-af8b-4308-bab7-6b261fbaac23 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3e65d886-c320-43c1-b4a0-acd4819c4aa6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7bd988e6-2469-4cc6-aa3a-6efacb67ddc7 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.801a79d2-6ba6-40cd-b942-9e634e0d01b7" returned: 0 in 0.599s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7bd988e6-2469-4cc6-aa3a-6efacb67ddc7 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.801a79d2-6ba6-40cd-b942-9e634e0d01b7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:20 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3e65d886-c320-43c1-b4a0-acd4819c4aa6 Jul 22 12:25:20 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75803b6e-afa3-4f67-97b5-f3ae8f255e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1806009490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef962a46-bc56-4409-aadb-702839a8495e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='861c28948bfc42b48e8ff1ee71766005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:21Z,use_quota=True,user_id='7fd78d3c699848d4ab05b7404edbc5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f29680-8c47-40ad-a144-6e425b470c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:20 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.801a79d2-6ba6-40cd-b942-9e634e0d01b7 Jul 22 12:25:20 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f29680-8c47-40ad-a144-6e425b470c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284821e6-0a24-4ca7-bbe3-121a123982a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284821e6-0a24-4ca7-bbe3-121a123982a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef962a46-bc56-4409-aadb-702839a8495e', 'volume_name': 'volume-ef962a46-bc56-4409-aadb-702839a8495e', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a8fdf0-c6c4-47e2-b62a-0a46a8243dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a8fdf0-c6c4-47e2-b62a-0a46a8243dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e05411a-12af-46b6-a061-86fe0f37442b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:21 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Volume ef962a46-bc56-4409-aadb-702839a8495e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef962a46-bc56-4409-aadb-702839a8495e', 'volume_size': 1} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Flow 'volume_create_manager' (6cad9b50-c109-42fd-969c-1fdc14de2049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd44bb87-2ee6-4f97-afcf-3e34f4781884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd44bb87-2ee6-4f97-afcf-3e34f4781884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-743066312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6403b7-1f01-4867-a3af-37868d5676ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9d7b43f3b349c5bff6d4542a593693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:21Z,use_quota=True,user_id='70f2aff194fd45b0a4ef7b570b78d6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd9b299-bdd4-473a-92d0-ef3ab682f069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd9b299-bdd4-473a-92d0-ef3ab682f069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ef9c58-eb64-480b-b7a9-f26b5f471150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ef9c58-eb64-480b-b7a9-f26b5f471150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f6403b7-1f01-4867-a3af-37868d5676ff', 'volume_name': 'volume-2f6403b7-1f01-4867-a3af-37868d5676ff', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e63a89d-bde3-4a26-9012-c007b6d170fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e63a89d-bde3-4a26-9012-c007b6d170fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5411dc-f0e3-400d-ba7c-72689d3960b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:21 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Volume 2f6403b7-1f01-4867-a3af-37868d5676ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f6403b7-1f01-4867-a3af-37868d5676ff', 'volume_size': 1} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:21 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Flow 'volume_create_manager' (8a25628f-9d3c-431a-8226-0946cc1a0caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (718b76bf-41f9-449b-85ca-2af2d2e23c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0 1073741824" returned: 0 in 0.725s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:21 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (718b76bf-41f9-449b-85ca-2af2d2e23c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1171429058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6410c69d-a113-4433-bccf-75915ec04613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9d7b43f3b349c5bff6d4542a593693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:21Z,use_quota=True,user_id='70f2aff194fd45b0a4ef7b570b78d6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:21 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be42859-7524-4830-a7c7-cf9366fc8cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be42859-7524-4830-a7c7-cf9366fc8cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ec0c4b-ea28-48c5-a6c1-253dfab05bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ec0c4b-ea28-48c5-a6c1-253dfab05bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6410c69d-a113-4433-bccf-75915ec04613', 'volume_name': 'volume-6410c69d-a113-4433-bccf-75915ec04613', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd961ed-ad4b-4808-9ecf-9331350fa6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd961ed-ad4b-4808-9ecf-9331350fa6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2231e5-4efa-4b8c-b4f5-dee07b1f89a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:21 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Volume 6410c69d-a113-4433-bccf-75915ec04613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6410c69d-a113-4433-bccf-75915ec04613', 'volume_size': 1} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7bd988e6-2469-4cc6-aa3a-6efacb67ddc7 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6.801a79d2-6ba6-40cd-b942-9e634e0d01b7" returned: 0 in 0.466s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b20e6c93-af8b-4308-bab7-6b261fbaac23 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-3e65d886-c320-43c1-b4a0-acd4819c4aa6" returned: 0 in 0.504s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b20e6c93-af8b-4308-bab7-6b261fbaac23 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-quobyte-3e65d886-c320-43c1-b4a0-acd4819c4aa6" released by "delete_volume" :: held 1.211s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7bd988e6-2469-4cc6-aa3a-6efacb67ddc7 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-801a79d2-6ba6-40cd-b942-9e634e0d01b7" released by "_delete_snapshot" :: held 2.391s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7bd988e6-2469-4cc6-aa3a-6efacb67ddc7 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6" released by "delete_snapshot" :: held 2.452s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:21 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0 Jul 22 12:25:21 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-b20e6c93-af8b-4308-bab7-6b261fbaac23 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Created reservations ['485ebfae-7fae-4601-9f11-f2cdc1368279', '16146a48-8959-4a0b-8f27-74ef8e5b6ab2', '363ad7b7-9086-4e23-8788-b4f024b76a9c', '3701c197-8abf-4b40-a845-202a8115129c'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-7bd988e6-2469-4cc6-aa3a-6efacb67ddc7 tempest-ProjectMemberTests-872887571 None] Created reservations ['77111c18-60c3-48af-9dc4-1f63b6fe5659', '396bc64b-9ffd-4939-aeae-5bb1186a4dfc', '6135b652-1818-4a9f-b7f4-656bb5106595', 'b6971ee9-cf99-4a03-b2cd-c4092b900ea0'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Flow 'volume_create_manager' (1dab00bc-bcfb-4cbe-86ae-f0d1916abb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37284730-6f5f-4c2b-9b91-de23219d6728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37284730-6f5f-4c2b-9b91-de23219d6728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1108786815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e09923-1997-431f-93df-1e01a5998c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9d7b43f3b349c5bff6d4542a593693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:22Z,use_quota=True,user_id='70f2aff194fd45b0a4ef7b570b78d6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c06ad3fb-217f-44b8-90e8-52c7135e6edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c06ad3fb-217f-44b8-90e8-52c7135e6edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f450592c-8f95-4f74-9fb8-eeca25f97ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f450592c-8f95-4f74-9fb8-eeca25f97ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7e09923-1997-431f-93df-1e01a5998c80', 'volume_name': 'volume-d7e09923-1997-431f-93df-1e01a5998c80', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c1a643-d3fe-4f9d-b87a-794380366032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c1a643-d3fe-4f9d-b87a-794380366032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff1554b-e6f3-4d02-8c59-abb63122acff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:21 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Volume d7e09923-1997-431f-93df-1e01a5998c80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7e09923-1997-431f-93df-1e01a5998c80', 'volume_size': 1} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b20e6c93-af8b-4308-bab7-6b261fbaac23 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b20e6c93-af8b-4308-bab7-6b261fbaac23 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b20e6c93-af8b-4308-bab7-6b261fbaac23 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:21 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b20e6c93-af8b-4308-bab7-6b261fbaac23 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b20e6c93-af8b-4308-bab7-6b261fbaac23 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b20e6c93-af8b-4308-bab7-6b261fbaac23 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0" returned: 0 in 0.309s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.760s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1806009490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef962a46-bc56-4409-aadb-702839a8495e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='861c28948bfc42b48e8ff1ee71766005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:21Z,use_quota=True,user_id='7fd78d3c699848d4ab05b7404edbc5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Creating volume ef962a46-bc56-4409-aadb-702839a8495e {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:21 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:21 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:21 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c95b33-3330-4f6d-b23d-f3fb9963f33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (883d547a-983b-4a6b-b7a1-937a5a5c7683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:21 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-7bd988e6-2469-4cc6-aa3a-6efacb67ddc7 tempest-ProjectMemberTests-872887571 None] Delete snapshot completed successfully. Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7bd988e6-2469-4cc6-aa3a-6efacb67ddc7 tempest-ProjectMemberTests-872887571 None] Lock "cinder-801a79d2-6ba6-40cd-b942-9e634e0d01b7-delete_snapshot" released by "delete_snapshot" :: held 2.850s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:21 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Volume volume-a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0 (a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0): created successfully Jul 22 12:25:21 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e 1073741824 Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (883d547a-983b-4a6b-b7a1-937a5a5c7683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:21 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:21 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Flow 'volume_create_manager' (8bc9e96c-2b01-43ae-9351-6d64d897c7c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:21 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-a54b8800-ff51-47a8-9067-f1e018eaa9ac tempest-CreateVolumesFromImageTest-405719498 None] Created volume successfully. Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Flow 'volume_create_manager' (b1140d54-9c5f-4095-a767-c777ad80834b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f58ee1b-6696-4be3-9bf4-c91753278bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:22 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f58ee1b-6696-4be3-9bf4-c91753278bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-925663417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50318fdd-9408-452a-96d4-907836455b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9d7b43f3b349c5bff6d4542a593693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:22Z,use_quota=True,user_id='70f2aff194fd45b0a4ef7b570b78d6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d22328-b3bb-4de2-aa9a-def8a8625fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d22328-b3bb-4de2-aa9a-def8a8625fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d1d617-0e86-4133-b667-f18c35ba7217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d1d617-0e86-4133-b667-f18c35ba7217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50318fdd-9408-452a-96d4-907836455b4c', 'volume_name': 'volume-50318fdd-9408-452a-96d4-907836455b4c', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f755da5b-6c2d-447c-91b0-7ed571b40b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f755da5b-6c2d-447c-91b0-7ed571b40b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967d4c81-6b40-4e4b-896e-067149fdc8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:22 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Volume 50318fdd-9408-452a-96d4-907836455b4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50318fdd-9408-452a-96d4-907836455b4c', 'volume_size': 1} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b20e6c93-af8b-4308-bab7-6b261fbaac23 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.353s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-b20e6c93-af8b-4308-bab7-6b261fbaac23 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:22 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b20e6c93-af8b-4308-bab7-6b261fbaac23 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Deleted volume successfully. Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b20e6c93-af8b-4308-bab7-6b261fbaac23 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-3e65d886-c320-43c1-b4a0-acd4819c4aa6-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:22 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e 1073741824" returned: 0 in 0.501s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:22 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e Jul 22 12:25:22 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-48159e3d-845a-40b0-b545-8e1b8694e7e6 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-48159e3d-845a-40b0-b545-8e1b8694e7e6 tempest-ProjectMemberTests-872887571 None] Lock "cinder-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-48159e3d-845a-40b0-b545-8e1b8694e7e6 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-48159e3d-845a-40b0-b545-8e1b8694e7e6 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6" acquired by "delete_volume" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-67611220-d825-460e-9fa1-4a756221eb49 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "cinder-cb25db95-25ad-4a02-95c9-35033d17cbed-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:22 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ae72d8-3956-4314-ab88-61f7f4a7a85a]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-48159e3d-845a-40b0-b545-8e1b8694e7e6 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-67611220-d825-460e-9fa1-4a756221eb49 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-cb25db95-25ad-4a02-95c9-35033d17cbed-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e" returned: 0 in 0.319s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.456s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-743066312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6403b7-1f01-4867-a3af-37868d5676ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9d7b43f3b349c5bff6d4542a593693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:21Z,use_quota=True,user_id='70f2aff194fd45b0a4ef7b570b78d6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Creating volume 2f6403b7-1f01-4867-a3af-37868d5676ff {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:22 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2f6403b7-1f01-4867-a3af-37868d5676ff 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e05411a-12af-46b6-a061-86fe0f37442b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef962a46-bc56-4409-aadb-702839a8495e', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:22 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2f6403b7-1f01-4867-a3af-37868d5676ff 1073741824 Jul 22 12:25:22 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7448bb5f-234a-4f92-af12-c8c01a7cc20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-67611220-d825-460e-9fa1-4a756221eb49 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "cinder-quobyte-cb25db95-25ad-4a02-95c9-35033d17cbed" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:22 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Volume volume-ef962a46-bc56-4409-aadb-702839a8495e (ef962a46-bc56-4409-aadb-702839a8495e): created successfully Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7448bb5f-234a-4f92-af12-c8c01a7cc20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:22 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6 Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Flow 'volume_create_manager' (21e3310f-301c-4e6d-bba1-16faa248f9ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:22 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-67611220-d825-460e-9fa1-4a756221eb49 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-quobyte-cb25db95-25ad-4a02-95c9-35033d17cbed" acquired by "delete_volume" :: waited 0.033s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:22 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-97b24235-6590-4c22-957f-2db420a6b3dd tempest-CinderUnicodeTest-911555230 None] Created volume successfully. Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[60afd3a0-0eda-49ea-a3ff-59db9d77c978]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-67611220-d825-460e-9fa1-4a756221eb49 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cb25db95-25ad-4a02-95c9-35033d17cbed {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:22 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cb25db95-25ad-4a02-95c9-35033d17cbed Jul 22 12:25:22 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:23 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-48159e3d-845a-40b0-b545-8e1b8694e7e6 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6" returned: 0 in 0.394s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-48159e3d-845a-40b0-b545-8e1b8694e7e6 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:23 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6 Jul 22 12:25:23 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:23 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2f6403b7-1f01-4867-a3af-37868d5676ff 1073741824" returned: 0 in 0.511s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:23 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2f6403b7-1f01-4867-a3af-37868d5676ff {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-67611220-d825-460e-9fa1-4a756221eb49 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cb25db95-25ad-4a02-95c9-35033d17cbed" returned: 0 in 0.444s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-67611220-d825-460e-9fa1-4a756221eb49 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cb25db95-25ad-4a02-95c9-35033d17cbed {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:23 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2f6403b7-1f01-4867-a3af-37868d5676ff Jul 22 12:25:23 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:23 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cb25db95-25ad-4a02-95c9-35033d17cbed Jul 22 12:25:23 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:23 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-48159e3d-845a-40b0-b545-8e1b8694e7e6 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6" returned: 0 in 0.296s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-48159e3d-845a-40b0-b545-8e1b8694e7e6 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6" released by "delete_volume" :: held 0.772s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-48159e3d-845a-40b0-b545-8e1b8694e7e6 tempest-ProjectMemberTests-872887571 None] Created reservations ['8ff08567-864d-413d-a60c-0bb43ee460d3', '8e120198-8389-472e-94dd-6c333e834851', '23cf19cb-fa82-46f3-93c5-33e634cb744f', '0bae8f05-ce02-485a-99eb-fcf687af572b'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-48159e3d-845a-40b0-b545-8e1b8694e7e6 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-48159e3d-845a-40b0-b545-8e1b8694e7e6 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-48159e3d-845a-40b0-b545-8e1b8694e7e6 tempest-ProjectMemberTests-872887571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-48159e3d-845a-40b0-b545-8e1b8694e7e6 tempest-ProjectMemberTests-872887571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-48159e3d-845a-40b0-b545-8e1b8694e7e6 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-48159e3d-845a-40b0-b545-8e1b8694e7e6 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:23 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:23 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:23 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2f6403b7-1f01-4867-a3af-37868d5676ff" returned: 0 in 0.328s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.189s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1171429058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6410c69d-a113-4433-bccf-75915ec04613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9d7b43f3b349c5bff6d4542a593693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:21Z,use_quota=True,user_id='70f2aff194fd45b0a4ef7b570b78d6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Creating volume 6410c69d-a113-4433-bccf-75915ec04613 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:23 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:23 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6410c69d-a113-4433-bccf-75915ec04613 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-67611220-d825-460e-9fa1-4a756221eb49 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-cb25db95-25ad-4a02-95c9-35033d17cbed" returned: 0 in 0.363s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:23 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6410c69d-a113-4433-bccf-75915ec04613 1073741824 Jul 22 12:25:23 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5411dc-f0e3-400d-ba7c-72689d3960b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f6403b7-1f01-4867-a3af-37868d5676ff', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae35b33c-0e3a-4346-8b11-e675e69ca93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-67611220-d825-460e-9fa1-4a756221eb49 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-quobyte-cb25db95-25ad-4a02-95c9-35033d17cbed" released by "delete_volume" :: held 0.918s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:23 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Volume volume-2f6403b7-1f01-4867-a3af-37868d5676ff (2f6403b7-1f01-4867-a3af-37868d5676ff): created successfully Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae35b33c-0e3a-4346-8b11-e675e69ca93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Flow 'volume_create_manager' (6cad9b50-c109-42fd-969c-1fdc14de2049) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:23 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d3826753-9d33-4e43-b7a9-459b76f4cb54 tempest-CreateVolumesFromImageTest-405719498 None] Created volume successfully. Jul 22 12:25:23 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-48159e3d-845a-40b0-b545-8e1b8694e7e6 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.327s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-48159e3d-845a-40b0-b545-8e1b8694e7e6 tempest-ProjectMemberTests-872887571 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:23 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-48159e3d-845a-40b0-b545-8e1b8694e7e6 tempest-ProjectMemberTests-872887571 None] Deleted volume successfully. Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-67611220-d825-460e-9fa1-4a756221eb49 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Created reservations ['acc7f3a8-ec39-4b4f-ba30-fbf66d520f2f', '2ee8f070-138a-4f37-ba2f-78c84141d44b', 'e8d21f46-b1f9-4339-810b-c5f454e94c27', 'fbe29d05-8e16-4b0d-ab98-96097ef5a7c0'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f5e18ace-fa64-48a3-9f65-800bbb350f10 tempest-CinderUnicodeTest-911555230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-48159e3d-845a-40b0-b545-8e1b8694e7e6 tempest-ProjectMemberTests-872887571 None] Lock "cinder-2afb4bf6-f25f-4dc4-a0bc-dee7dee8a7e6-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-67611220-d825-460e-9fa1-4a756221eb49 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-67611220-d825-460e-9fa1-4a756221eb49 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-67611220-d825-460e-9fa1-4a756221eb49 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-67611220-d825-460e-9fa1-4a756221eb49 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-67611220-d825-460e-9fa1-4a756221eb49 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-67611220-d825-460e-9fa1-4a756221eb49 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:23 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:23 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:24 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6410c69d-a113-4433-bccf-75915ec04613 1073741824" returned: 0 in 0.735s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:24 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-67611220-d825-460e-9fa1-4a756221eb49 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.393s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-67611220-d825-460e-9fa1-4a756221eb49 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:24 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-67611220-d825-460e-9fa1-4a756221eb49 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Deleted volume successfully. Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Flow 'volume_create_manager' (799fd767-5f11-4920-8c96-632bfa3f45a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9be2a6-7be4-4a61-8a54-a399925ca501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6410c69d-a113-4433-bccf-75915ec04613 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-67611220-d825-460e-9fa1-4a756221eb49 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-cb25db95-25ad-4a02-95c9-35033d17cbed-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:24 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6410c69d-a113-4433-bccf-75915ec04613 Jul 22 12:25:24 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9be2a6-7be4-4a61-8a54-a399925ca501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1241885465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4e7491-568f-43d3-8b76-1b98bdd702f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89707e5757184c76b39c42c3553f59c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:24Z,use_quota=True,user_id='edd7857f9fd44201b44894c8b9b98d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a397249a-0f5d-4f18-8816-d7126b3c9e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:24 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a397249a-0f5d-4f18-8816-d7126b3c9e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:24 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0dfc15-6016-4d13-a87a-f5a69ad85e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0dfc15-6016-4d13-a87a-f5a69ad85e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d4e7491-568f-43d3-8b76-1b98bdd702f0', 'volume_name': 'volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba97ab7-e06a-4a32-87a9-b8e625124bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba97ab7-e06a-4a32-87a9-b8e625124bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d328fad7-de94-4da4-bac7-cd4792b7d249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:24 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Volume 9d4e7491-568f-43d3-8b76-1b98bdd702f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0', 'volume_size': 1} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:24 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6410c69d-a113-4433-bccf-75915ec04613" returned: 0 in 0.276s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.979s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1108786815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e09923-1997-431f-93df-1e01a5998c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9d7b43f3b349c5bff6d4542a593693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:22Z,use_quota=True,user_id='70f2aff194fd45b0a4ef7b570b78d6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Creating volume d7e09923-1997-431f-93df-1e01a5998c80 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:24 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d7e09923-1997-431f-93df-1e01a5998c80 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:24 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.272s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread count: 28 {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread info: [<_MainThread(MainThread, started 137793405739136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:25:24 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d7e09923-1997-431f-93df-1e01a5998c80 1073741824 Jul 22 12:25:24 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2231e5-4efa-4b8c-b4f5-dee07b1f89a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6410c69d-a113-4433-bccf-75915ec04613', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cb0dee-82c8-4d50-9798-602fc064e941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:24 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Volume volume-6410c69d-a113-4433-bccf-75915ec04613 (6410c69d-a113-4433-bccf-75915ec04613): created successfully Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cb0dee-82c8-4d50-9798-602fc064e941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Flow 'volume_create_manager' (8a25628f-9d3c-431a-8226-0946cc1a0caf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:24 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-c4e6b148-cfb8-4329-8de6-3cb24c53b69a tempest-CreateVolumesFromImageTest-405719498 None] Created volume successfully. Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-eef87eb1-d730-4542-a544-89366bb94534 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "cinder-ebe03715-854f-4071-b572-90f1688e063f-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-eef87eb1-d730-4542-a544-89366bb94534 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-ebe03715-854f-4071-b572-90f1688e063f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-eef87eb1-d730-4542-a544-89366bb94534 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "cinder-quobyte-7e41743c-4ec5-4151-9006-7299349f8137" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-eef87eb1-d730-4542-a544-89366bb94534 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-quobyte-7e41743c-4ec5-4151-9006-7299349f8137" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-eef87eb1-d730-4542-a544-89366bb94534 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "cinder-quobyte-ebe03715-854f-4071-b572-90f1688e063f" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-eef87eb1-d730-4542-a544-89366bb94534 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-quobyte-ebe03715-854f-4071-b572-90f1688e063f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-eef87eb1-d730-4542-a544-89366bb94534 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Deleting offline snapshot ebe03715-854f-4071-b572-90f1688e063f of volume 7e41743c-4ec5-4151-9006-7299349f8137 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-eef87eb1-d730-4542-a544-89366bb94534 tempest-CreateVolumesFromSnapshotTest-1983980424 None] snapshot_file for this snap is: volume-7e41743c-4ec5-4151-9006-7299349f8137.ebe03715-854f-4071-b572-90f1688e063f {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c959a7-7d92-44ce-a7fa-2f7239197841]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eef87eb1-d730-4542-a544-89366bb94534 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.ebe03715-854f-4071-b572-90f1688e063f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:25 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.ebe03715-854f-4071-b572-90f1688e063f Jul 22 12:25:25 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:25 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d7e09923-1997-431f-93df-1e01a5998c80 1073741824" returned: 0 in 0.551s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d7e09923-1997-431f-93df-1e01a5998c80 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:25 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d7e09923-1997-431f-93df-1e01a5998c80 Jul 22 12:25:25 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:25 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eef87eb1-d730-4542-a544-89366bb94534 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.ebe03715-854f-4071-b572-90f1688e063f" returned: 0 in 0.451s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-eef87eb1-d730-4542-a544-89366bb94534 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e41743c-4ec5-4151-9006-7299349f8137(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80e1833-62ec-427b-9c2a-47a7b801df14]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eef87eb1-d730-4542-a544-89366bb94534 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:25 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d7e09923-1997-431f-93df-1e01a5998c80" returned: 0 in 0.275s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.505s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-925663417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50318fdd-9408-452a-96d4-907836455b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9d7b43f3b349c5bff6d4542a593693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:22Z,use_quota=True,user_id='70f2aff194fd45b0a4ef7b570b78d6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Creating volume 50318fdd-9408-452a-96d4-907836455b4c {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:25 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-50318fdd-9408-452a-96d4-907836455b4c 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:25 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137 Jul 22 12:25:25 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff1554b-e6f3-4d02-8c59-abb63122acff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7e09923-1997-431f-93df-1e01a5998c80', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:25 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-50318fdd-9408-452a-96d4-907836455b4c 1073741824 Jul 22 12:25:25 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e62c825-458f-4c21-819e-8bccb1c4eee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:25 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Volume volume-d7e09923-1997-431f-93df-1e01a5998c80 (d7e09923-1997-431f-93df-1e01a5998c80): created successfully Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e62c825-458f-4c21-819e-8bccb1c4eee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Flow 'volume_create_manager' (1dab00bc-bcfb-4cbe-86ae-f0d1916abb17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:25 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-9dabfa42-fdb8-4f0c-a4a5-f62146edb6ec tempest-CreateVolumesFromImageTest-405719498 None] Created volume successfully. Jul 22 12:25:25 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eef87eb1-d730-4542-a544-89366bb94534 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137" returned: 0 in 0.377s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eef87eb1-d730-4542-a544-89366bb94534 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.ebe03715-854f-4071-b572-90f1688e063f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:25 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.ebe03715-854f-4071-b572-90f1688e063f Jul 22 12:25:25 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:26 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-50318fdd-9408-452a-96d4-907836455b4c 1073741824" returned: 0 in 0.453s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-50318fdd-9408-452a-96d4-907836455b4c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:26 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-50318fdd-9408-452a-96d4-907836455b4c Jul 22 12:25:26 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:26 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eef87eb1-d730-4542-a544-89366bb94534 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.ebe03715-854f-4071-b572-90f1688e063f" returned: 0 in 0.358s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eef87eb1-d730-4542-a544-89366bb94534 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.ebe03715-854f-4071-b572-90f1688e063f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:26 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.ebe03715-854f-4071-b572-90f1688e063f Jul 22 12:25:26 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:26 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-50318fdd-9408-452a-96d4-907836455b4c" returned: 0 in 0.252s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f5e18ace-fa64-48a3-9f65-800bbb350f10 tempest-CinderUnicodeTest-911555230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.484s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967d4c81-6b40-4e4b-896e-067149fdc8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50318fdd-9408-452a-96d4-907836455b4c', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d4d9012-733b-4ee6-893e-d7e531ac6543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-f5e18ace-fa64-48a3-9f65-800bbb350f10 tempest-CinderUnicodeTest-911555230 None] Creating offline snapshot 759351c1-34eb-495e-8cec-f8e91f1b42a2 of volume ef962a46-bc56-4409-aadb-702839a8495e {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:25:26 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Volume volume-50318fdd-9408-452a-96d4-907836455b4c (50318fdd-9408-452a-96d4-907836455b4c): created successfully Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d4d9012-733b-4ee6-893e-d7e531ac6543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Flow 'volume_create_manager' (b1140d54-9c5f-4095-a767-c777ad80834b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f40ac9b-e930-400f-a096-710debb631bb]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f5e18ace-fa64-48a3-9f65-800bbb350f10 tempest-CinderUnicodeTest-911555230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:26 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-8a34234a-cbfb-4da3-b96c-489c7d138534 tempest-CreateVolumesFromImageTest-405719498 None] Created volume successfully. Jul 22 12:25:26 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-eef87eb1-d730-4542-a544-89366bb94534 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137.ebe03715-854f-4071-b572-90f1688e063f" returned: 0 in 0.275s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:26 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e Jul 22 12:25:26 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-eef87eb1-d730-4542-a544-89366bb94534 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-quobyte-ebe03715-854f-4071-b572-90f1688e063f" released by "_delete_snapshot" :: held 1.591s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-eef87eb1-d730-4542-a544-89366bb94534 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-quobyte-7e41743c-4ec5-4151-9006-7299349f8137" released by "delete_snapshot" :: held 1.621s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-349b99d1-3445-4879-a64a-acdffd7f8465 tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "cinder-50318fdd-9408-452a-96d4-907836455b4c-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-349b99d1-3445-4879-a64a-acdffd7f8465 tempest-CreateVolumesFromImageTest-405719498 None] Lock "cinder-50318fdd-9408-452a-96d4-907836455b4c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-349b99d1-3445-4879-a64a-acdffd7f8465 tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "cinder-quobyte-50318fdd-9408-452a-96d4-907836455b4c" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-349b99d1-3445-4879-a64a-acdffd7f8465 tempest-CreateVolumesFromImageTest-405719498 None] Lock "cinder-quobyte-50318fdd-9408-452a-96d4-907836455b4c" acquired by "delete_volume" :: waited 0.027s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-eef87eb1-d730-4542-a544-89366bb94534 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Created reservations ['3fe0441c-795d-46a0-89bb-128e2c7351a2', '01b34559-e558-40e5-88d8-b4a263e090aa', '08c764e9-b4ed-431d-910d-e17561efebed', 'e2fde0f8-2045-4e69-a6bd-9897f14b2c0c'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e039ea38-7e75-4eab-8c72-978cdb950e4e]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-349b99d1-3445-4879-a64a-acdffd7f8465 tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-50318fdd-9408-452a-96d4-907836455b4c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:26 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-eef87eb1-d730-4542-a544-89366bb94534 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Delete snapshot completed successfully. Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-eef87eb1-d730-4542-a544-89366bb94534 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-ebe03715-854f-4071-b572-90f1688e063f-delete_snapshot" released by "delete_snapshot" :: held 1.874s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:26 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:26 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-50318fdd-9408-452a-96d4-907836455b4c Jul 22 12:25:26 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f5e18ace-fa64-48a3-9f65-800bbb350f10 tempest-CinderUnicodeTest-911555230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e" returned: 0 in 0.426s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f5e18ace-fa64-48a3-9f65-800bbb350f10 tempest-CinderUnicodeTest-911555230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.759351c1-34eb-495e-8cec-f8e91f1b42a2 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:26 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.759351c1-34eb-495e-8cec-f8e91f1b42a2 1G Jul 22 12:25:26 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7469af48-3ecc-468f-9a57-9e656380c461 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "cinder-7e41743c-4ec5-4151-9006-7299349f8137-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7469af48-3ecc-468f-9a57-9e656380c461 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-7e41743c-4ec5-4151-9006-7299349f8137-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:27 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-349b99d1-3445-4879-a64a-acdffd7f8465 tempest-CreateVolumesFromImageTest-405719498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-50318fdd-9408-452a-96d4-907836455b4c" returned: 0 in 0.463s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-349b99d1-3445-4879-a64a-acdffd7f8465 tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-50318fdd-9408-452a-96d4-907836455b4c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7469af48-3ecc-468f-9a57-9e656380c461 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "cinder-quobyte-7e41743c-4ec5-4151-9006-7299349f8137" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:27 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-50318fdd-9408-452a-96d4-907836455b4c Jul 22 12:25:27 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7469af48-3ecc-468f-9a57-9e656380c461 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-quobyte-7e41743c-4ec5-4151-9006-7299349f8137" acquired by "delete_volume" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[4329f5f6-4601-4e5d-90aa-c9450c71cf12]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7469af48-3ecc-468f-9a57-9e656380c461 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:27 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f5e18ace-fa64-48a3-9f65-800bbb350f10 tempest-CinderUnicodeTest-911555230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.759351c1-34eb-495e-8cec-f8e91f1b42a2 1G" returned: 0 in 0.482s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f5e18ace-fa64-48a3-9f65-800bbb350f10 tempest-CinderUnicodeTest-911555230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef962a46-bc56-4409-aadb-702839a8495e -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.759351c1-34eb-495e-8cec-f8e91f1b42a2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:27 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef962a46-bc56-4409-aadb-702839a8495e -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.759351c1-34eb-495e-8cec-f8e91f1b42a2 Jul 22 12:25:27 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:27 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137 Jul 22 12:25:27 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:27 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-349b99d1-3445-4879-a64a-acdffd7f8465 tempest-CreateVolumesFromImageTest-405719498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-50318fdd-9408-452a-96d4-907836455b4c" returned: 0 in 0.276s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-349b99d1-3445-4879-a64a-acdffd7f8465 tempest-CreateVolumesFromImageTest-405719498 None] Lock "cinder-quobyte-50318fdd-9408-452a-96d4-907836455b4c" released by "delete_volume" :: held 0.787s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-349b99d1-3445-4879-a64a-acdffd7f8465 tempest-CreateVolumesFromImageTest-405719498 None] Created reservations ['e56091d4-cfb3-44c3-ba2e-6a4923d8df36', '32b6ed45-88c7-4321-945e-f447174fb737', 'c245f437-c097-4adc-915b-58c69e86d706', 'd9db08d7-9e54-4942-a661-393edce293b1'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-349b99d1-3445-4879-a64a-acdffd7f8465 tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-349b99d1-3445-4879-a64a-acdffd7f8465 tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-349b99d1-3445-4879-a64a-acdffd7f8465 tempest-CreateVolumesFromImageTest-405719498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-349b99d1-3445-4879-a64a-acdffd7f8465 tempest-CreateVolumesFromImageTest-405719498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-349b99d1-3445-4879-a64a-acdffd7f8465 tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-349b99d1-3445-4879-a64a-acdffd7f8465 tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:27 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:27 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:27 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f5e18ace-fa64-48a3-9f65-800bbb350f10 tempest-CinderUnicodeTest-911555230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef962a46-bc56-4409-aadb-702839a8495e -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.759351c1-34eb-495e-8cec-f8e91f1b42a2" returned: 0 in 0.321s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:27 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-f5e18ace-fa64-48a3-9f65-800bbb350f10 tempest-CinderUnicodeTest-911555230 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.759351c1-34eb-495e-8cec-f8e91f1b42a2 is being set with open permissions: ugo+rw Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f5e18ace-fa64-48a3-9f65-800bbb350f10 tempest-CinderUnicodeTest-911555230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.759351c1-34eb-495e-8cec-f8e91f1b42a2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:27 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7469af48-3ecc-468f-9a57-9e656380c461 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137" returned: 0 in 0.404s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7469af48-3ecc-468f-9a57-9e656380c461 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:27 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.759351c1-34eb-495e-8cec-f8e91f1b42a2 Jul 22 12:25:27 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:27 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137 Jul 22 12:25:27 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e33c47ac-cb7a-40cc-9205-cf9ab9acf468 tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "cinder-d7e09923-1997-431f-93df-1e01a5998c80-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e33c47ac-cb7a-40cc-9205-cf9ab9acf468 tempest-CreateVolumesFromImageTest-405719498 None] Lock "cinder-d7e09923-1997-431f-93df-1e01a5998c80-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e33c47ac-cb7a-40cc-9205-cf9ab9acf468 tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "cinder-quobyte-d7e09923-1997-431f-93df-1e01a5998c80" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e33c47ac-cb7a-40cc-9205-cf9ab9acf468 tempest-CreateVolumesFromImageTest-405719498 None] Lock "cinder-quobyte-d7e09923-1997-431f-93df-1e01a5998c80" acquired by "delete_volume" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e594eb06-22f3-4bac-b732-5d21f149a42a]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e33c47ac-cb7a-40cc-9205-cf9ab9acf468 tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d7e09923-1997-431f-93df-1e01a5998c80 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:27 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-349b99d1-3445-4879-a64a-acdffd7f8465 tempest-CreateVolumesFromImageTest-405719498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.331s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-349b99d1-3445-4879-a64a-acdffd7f8465 tempest-CreateVolumesFromImageTest-405719498 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:27 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-349b99d1-3445-4879-a64a-acdffd7f8465 tempest-CreateVolumesFromImageTest-405719498 None] Deleted volume successfully. Jul 22 12:25:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-349b99d1-3445-4879-a64a-acdffd7f8465 tempest-CreateVolumesFromImageTest-405719498 None] Lock "cinder-50318fdd-9408-452a-96d4-907836455b4c-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:28 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f5e18ace-fa64-48a3-9f65-800bbb350f10 tempest-CinderUnicodeTest-911555230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.759351c1-34eb-495e-8cec-f8e91f1b42a2" returned: 0 in 0.339s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:28 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7469af48-3ecc-468f-9a57-9e656380c461 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-7e41743c-4ec5-4151-9006-7299349f8137" returned: 0 in 0.341s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7469af48-3ecc-468f-9a57-9e656380c461 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-quobyte-7e41743c-4ec5-4151-9006-7299349f8137" released by "delete_volume" :: held 0.806s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f5e18ace-fa64-48a3-9f65-800bbb350f10 tempest-CinderUnicodeTest-911555230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:28 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d7e09923-1997-431f-93df-1e01a5998c80 Jul 22 12:25:28 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:28 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.info Jul 22 12:25:28 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-7469af48-3ecc-468f-9a57-9e656380c461 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Created reservations ['de51fd99-cf64-4d4a-aae9-999262c76aee', '671cec85-170b-4aca-b2f5-8eab5e4d97a2', 'fc16b666-1fea-483b-9b0a-edb5bf817168', '2599af4f-f703-4275-9f53-40b5da88922a'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7469af48-3ecc-468f-9a57-9e656380c461 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7469af48-3ecc-468f-9a57-9e656380c461 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7469af48-3ecc-468f-9a57-9e656380c461 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7469af48-3ecc-468f-9a57-9e656380c461 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7469af48-3ecc-468f-9a57-9e656380c461 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7469af48-3ecc-468f-9a57-9e656380c461 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:28 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:28 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:28 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f5e18ace-fa64-48a3-9f65-800bbb350f10 tempest-CinderUnicodeTest-911555230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.info" returned: 0 in 0.276s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:28 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-f5e18ace-fa64-48a3-9f65-800bbb350f10 tempest-CinderUnicodeTest-911555230 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.info is being set with open permissions: ugo+rw Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f5e18ace-fa64-48a3-9f65-800bbb350f10 tempest-CinderUnicodeTest-911555230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:28 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e33c47ac-cb7a-40cc-9205-cf9ab9acf468 tempest-CreateVolumesFromImageTest-405719498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d7e09923-1997-431f-93df-1e01a5998c80" returned: 0 in 0.440s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e33c47ac-cb7a-40cc-9205-cf9ab9acf468 tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d7e09923-1997-431f-93df-1e01a5998c80 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:28 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.info Jul 22 12:25:28 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:28 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d7e09923-1997-431f-93df-1e01a5998c80 Jul 22 12:25:28 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:28 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7469af48-3ecc-468f-9a57-9e656380c461 tempest-CreateVolumesFromSnapshotTest-1983980424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.315s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-7469af48-3ecc-468f-9a57-9e656380c461 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:28 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-7469af48-3ecc-468f-9a57-9e656380c461 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Deleted volume successfully. Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7469af48-3ecc-468f-9a57-9e656380c461 tempest-CreateVolumesFromSnapshotTest-1983980424 None] Lock "cinder-7e41743c-4ec5-4151-9006-7299349f8137-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:28 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f5e18ace-fa64-48a3-9f65-800bbb350f10 tempest-CinderUnicodeTest-911555230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.info" returned: 0 in 0.305s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:28 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f5e18ace-fa64-48a3-9f65-800bbb350f10 tempest-CinderUnicodeTest-911555230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.295s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.166s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1241885465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4e7491-568f-43d3-8b76-1b98bdd702f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89707e5757184c76b39c42c3553f59c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:24Z,use_quota=True,user_id='edd7857f9fd44201b44894c8b9b98d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Creating volume 9d4e7491-568f-43d3-8b76-1b98bdd702f0 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:28 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e33c47ac-cb7a-40cc-9205-cf9ab9acf468 tempest-CreateVolumesFromImageTest-405719498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d7e09923-1997-431f-93df-1e01a5998c80" returned: 0 in 0.324s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:28 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0 1073741824 Jul 22 12:25:28 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e33c47ac-cb7a-40cc-9205-cf9ab9acf468 tempest-CreateVolumesFromImageTest-405719498 None] Lock "cinder-quobyte-d7e09923-1997-431f-93df-1e01a5998c80" released by "delete_volume" :: held 0.831s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:28 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-f5e18ace-fa64-48a3-9f65-800bbb350f10 tempest-CinderUnicodeTest-911555230 None] Create snapshot completed successfully Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-e33c47ac-cb7a-40cc-9205-cf9ab9acf468 tempest-CreateVolumesFromImageTest-405719498 None] Created reservations ['623207fe-ab08-4323-adfb-ad0299565537', '70a2174d-b447-40e7-9b75-26e470fc1356', '08a705f4-8050-450c-a476-a44eb6034279', 'd311170f-19f5-4a58-bd01-e7eae6f25ece'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e33c47ac-cb7a-40cc-9205-cf9ab9acf468 tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e33c47ac-cb7a-40cc-9205-cf9ab9acf468 tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e33c47ac-cb7a-40cc-9205-cf9ab9acf468 tempest-CreateVolumesFromImageTest-405719498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e33c47ac-cb7a-40cc-9205-cf9ab9acf468 tempest-CreateVolumesFromImageTest-405719498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e33c47ac-cb7a-40cc-9205-cf9ab9acf468 tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e33c47ac-cb7a-40cc-9205-cf9ab9acf468 tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:28 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:28 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ae9e009f-62ae-4a45-87a1-d0190987b206 tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "cinder-6410c69d-a113-4433-bccf-75915ec04613-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ae9e009f-62ae-4a45-87a1-d0190987b206 tempest-CreateVolumesFromImageTest-405719498 None] Lock "cinder-6410c69d-a113-4433-bccf-75915ec04613-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ae9e009f-62ae-4a45-87a1-d0190987b206 tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "cinder-quobyte-6410c69d-a113-4433-bccf-75915ec04613" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ae9e009f-62ae-4a45-87a1-d0190987b206 tempest-CreateVolumesFromImageTest-405719498 None] Lock "cinder-quobyte-6410c69d-a113-4433-bccf-75915ec04613" acquired by "delete_volume" :: waited 0.031s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-041b300e-0da1-4b9d-b14d-8a92044d9a58 tempest-CinderUnicodeTest-911555230 None] Acquiring lock "cinder-759351c1-34eb-495e-8cec-f8e91f1b42a2-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c759653-b568-4d97-8c96-8dcaa83b062f]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ae9e009f-62ae-4a45-87a1-d0190987b206 tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6410c69d-a113-4433-bccf-75915ec04613 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-041b300e-0da1-4b9d-b14d-8a92044d9a58 tempest-CinderUnicodeTest-911555230 None] Lock "cinder-759351c1-34eb-495e-8cec-f8e91f1b42a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:29 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-041b300e-0da1-4b9d-b14d-8a92044d9a58 tempest-CinderUnicodeTest-911555230 None] Acquiring lock "cinder-quobyte-ef962a46-bc56-4409-aadb-702839a8495e" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e33c47ac-cb7a-40cc-9205-cf9ab9acf468 tempest-CreateVolumesFromImageTest-405719498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.449s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-e33c47ac-cb7a-40cc-9205-cf9ab9acf468 tempest-CreateVolumesFromImageTest-405719498 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:29 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e33c47ac-cb7a-40cc-9205-cf9ab9acf468 tempest-CreateVolumesFromImageTest-405719498 None] Deleted volume successfully. Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-041b300e-0da1-4b9d-b14d-8a92044d9a58 tempest-CinderUnicodeTest-911555230 None] Lock "cinder-quobyte-ef962a46-bc56-4409-aadb-702839a8495e" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-041b300e-0da1-4b9d-b14d-8a92044d9a58 tempest-CinderUnicodeTest-911555230 None] Acquiring lock "cinder-quobyte-759351c1-34eb-495e-8cec-f8e91f1b42a2" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:29 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0 1073741824" returned: 0 in 0.705s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e33c47ac-cb7a-40cc-9205-cf9ab9acf468 tempest-CreateVolumesFromImageTest-405719498 None] Lock "cinder-d7e09923-1997-431f-93df-1e01a5998c80-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-041b300e-0da1-4b9d-b14d-8a92044d9a58 tempest-CinderUnicodeTest-911555230 None] Lock "cinder-quobyte-759351c1-34eb-495e-8cec-f8e91f1b42a2" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-041b300e-0da1-4b9d-b14d-8a92044d9a58 tempest-CinderUnicodeTest-911555230 None] Deleting offline snapshot 759351c1-34eb-495e-8cec-f8e91f1b42a2 of volume ef962a46-bc56-4409-aadb-702839a8495e {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:25:29 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6410c69d-a113-4433-bccf-75915ec04613 Jul 22 12:25:29 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-041b300e-0da1-4b9d-b14d-8a92044d9a58 tempest-CinderUnicodeTest-911555230 None] snapshot_file for this snap is: volume-ef962a46-bc56-4409-aadb-702839a8495e.759351c1-34eb-495e-8cec-f8e91f1b42a2 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[2634584c-3eb1-4539-8bc1-474eca1bcf36]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-041b300e-0da1-4b9d-b14d-8a92044d9a58 tempest-CinderUnicodeTest-911555230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.759351c1-34eb-495e-8cec-f8e91f1b42a2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:29 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0 Jul 22 12:25:29 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:29 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.759351c1-34eb-495e-8cec-f8e91f1b42a2 Jul 22 12:25:29 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:29 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ae9e009f-62ae-4a45-87a1-d0190987b206 tempest-CreateVolumesFromImageTest-405719498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6410c69d-a113-4433-bccf-75915ec04613" returned: 0 in 0.479s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ae9e009f-62ae-4a45-87a1-d0190987b206 tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6410c69d-a113-4433-bccf-75915ec04613 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:29 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0" returned: 0 in 0.342s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:29 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6410c69d-a113-4433-bccf-75915ec04613 Jul 22 12:25:29 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d328fad7-de94-4da4-bac7-cd4792b7d249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ffd73f8-7640-49cd-b55f-61b83a644d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:29 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Volume volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0 (9d4e7491-568f-43d3-8b76-1b98bdd702f0): created successfully Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ffd73f8-7640-49cd-b55f-61b83a644d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Flow 'volume_create_manager' (799fd767-5f11-4920-8c96-632bfa3f45a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:29 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-aae0acb7-e257-4eb7-80b8-04d257c25312 tempest-ProjectMemberTests-872887571 None] Created volume successfully. Jul 22 12:25:29 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-041b300e-0da1-4b9d-b14d-8a92044d9a58 tempest-CinderUnicodeTest-911555230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.759351c1-34eb-495e-8cec-f8e91f1b42a2" returned: 0 in 0.487s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-041b300e-0da1-4b9d-b14d-8a92044d9a58 tempest-CinderUnicodeTest-911555230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef962a46-bc56-4409-aadb-702839a8495e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[447ec3b1-8a6f-40d3-b4e7-c26544a91552]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-041b300e-0da1-4b9d-b14d-8a92044d9a58 tempest-CinderUnicodeTest-911555230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:30 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e Jul 22 12:25:30 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:30 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ae9e009f-62ae-4a45-87a1-d0190987b206 tempest-CreateVolumesFromImageTest-405719498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-6410c69d-a113-4433-bccf-75915ec04613" returned: 0 in 0.350s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ae9e009f-62ae-4a45-87a1-d0190987b206 tempest-CreateVolumesFromImageTest-405719498 None] Lock "cinder-quobyte-6410c69d-a113-4433-bccf-75915ec04613" released by "delete_volume" :: held 0.895s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:30 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-ae9e009f-62ae-4a45-87a1-d0190987b206 tempest-CreateVolumesFromImageTest-405719498 None] Created reservations ['9ccb10e6-2868-4f7f-b818-b5c5cbba9e67', '24fff0dc-f57a-405f-b287-e2ae64d1023c', '59d35679-3730-49c8-a725-d640eff2ce0a', '41cd0399-8944-48ba-83a9-15af7e225555'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ae9e009f-62ae-4a45-87a1-d0190987b206 tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ae9e009f-62ae-4a45-87a1-d0190987b206 tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ae9e009f-62ae-4a45-87a1-d0190987b206 tempest-CreateVolumesFromImageTest-405719498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ae9e009f-62ae-4a45-87a1-d0190987b206 tempest-CreateVolumesFromImageTest-405719498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ae9e009f-62ae-4a45-87a1-d0190987b206 tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ae9e009f-62ae-4a45-87a1-d0190987b206 tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:30 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:30 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:30 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-041b300e-0da1-4b9d-b14d-8a92044d9a58 tempest-CinderUnicodeTest-911555230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e" returned: 0 in 0.457s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-041b300e-0da1-4b9d-b14d-8a92044d9a58 tempest-CinderUnicodeTest-911555230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.759351c1-34eb-495e-8cec-f8e91f1b42a2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:30 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.759351c1-34eb-495e-8cec-f8e91f1b42a2 Jul 22 12:25:30 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:30 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ae9e009f-62ae-4a45-87a1-d0190987b206 tempest-CreateVolumesFromImageTest-405719498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.263s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:30 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-ae9e009f-62ae-4a45-87a1-d0190987b206 tempest-CreateVolumesFromImageTest-405719498 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:30 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-ae9e009f-62ae-4a45-87a1-d0190987b206 tempest-CreateVolumesFromImageTest-405719498 None] Deleted volume successfully. Jul 22 12:25:30 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ae9e009f-62ae-4a45-87a1-d0190987b206 tempest-CreateVolumesFromImageTest-405719498 None] Lock "cinder-6410c69d-a113-4433-bccf-75915ec04613-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:30 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-041b300e-0da1-4b9d-b14d-8a92044d9a58 tempest-CinderUnicodeTest-911555230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.759351c1-34eb-495e-8cec-f8e91f1b42a2" returned: 0 in 0.368s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-041b300e-0da1-4b9d-b14d-8a92044d9a58 tempest-CinderUnicodeTest-911555230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.759351c1-34eb-495e-8cec-f8e91f1b42a2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:30 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.759351c1-34eb-495e-8cec-f8e91f1b42a2 Jul 22 12:25:30 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:31 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-041b300e-0da1-4b9d-b14d-8a92044d9a58 tempest-CinderUnicodeTest-911555230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e.759351c1-34eb-495e-8cec-f8e91f1b42a2" returned: 0 in 0.279s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-041b300e-0da1-4b9d-b14d-8a92044d9a58 tempest-CinderUnicodeTest-911555230 None] Lock "cinder-quobyte-759351c1-34eb-495e-8cec-f8e91f1b42a2" released by "_delete_snapshot" :: held 1.737s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-041b300e-0da1-4b9d-b14d-8a92044d9a58 tempest-CinderUnicodeTest-911555230 None] Lock "cinder-quobyte-ef962a46-bc56-4409-aadb-702839a8495e" released by "delete_snapshot" :: held 1.790s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ed7be24d-de93-4472-8bc0-9b429169081b tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ed7be24d-de93-4472-8bc0-9b429169081b tempest-ProjectMemberTests-872887571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-ed7be24d-de93-4472-8bc0-9b429169081b tempest-ProjectMemberTests-872887571 None] Creating offline snapshot 28194be9-0260-40ea-9813-6b03399d66df of volume 9d4e7491-568f-43d3-8b76-1b98bdd702f0 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-041b300e-0da1-4b9d-b14d-8a92044d9a58 tempest-CinderUnicodeTest-911555230 None] Created reservations ['168a1bab-0a91-4067-bfbe-59503ff4eec3', '1d77e274-9d83-4b21-b0c0-c3a46a1a60d5', '1300e21d-a265-43f9-b427-5dae9447b118', '96dda092-020b-413d-91d4-72452eb87cd4'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[472e6aee-5ec9-48b1-99ce-2eba197e2a1d]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ed7be24d-de93-4472-8bc0-9b429169081b tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20050b50-1d93-41a2-9475-2505f6022416 tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "cinder-2f6403b7-1f01-4867-a3af-37868d5676ff-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20050b50-1d93-41a2-9475-2505f6022416 tempest-CreateVolumesFromImageTest-405719498 None] Lock "cinder-2f6403b7-1f01-4867-a3af-37868d5676ff-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:31 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-041b300e-0da1-4b9d-b14d-8a92044d9a58 tempest-CinderUnicodeTest-911555230 None] Delete snapshot completed successfully. Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-041b300e-0da1-4b9d-b14d-8a92044d9a58 tempest-CinderUnicodeTest-911555230 None] Lock "cinder-759351c1-34eb-495e-8cec-f8e91f1b42a2-delete_snapshot" released by "delete_snapshot" :: held 2.091s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20050b50-1d93-41a2-9475-2505f6022416 tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "cinder-quobyte-2f6403b7-1f01-4867-a3af-37868d5676ff" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:31 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0 Jul 22 12:25:31 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20050b50-1d93-41a2-9475-2505f6022416 tempest-CreateVolumesFromImageTest-405719498 None] Lock "cinder-quobyte-2f6403b7-1f01-4867-a3af-37868d5676ff" acquired by "delete_volume" :: waited 0.022s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[8779213b-76d7-482f-9cdc-a5b47a827ae7]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20050b50-1d93-41a2-9475-2505f6022416 tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2f6403b7-1f01-4867-a3af-37868d5676ff {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9357bc5c-1d57-4895-baa2-74f006b3e1cc tempest-CinderUnicodeTest-911555230 None] Acquiring lock "cinder-ef962a46-bc56-4409-aadb-702839a8495e-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9357bc5c-1d57-4895-baa2-74f006b3e1cc tempest-CinderUnicodeTest-911555230 None] Lock "cinder-ef962a46-bc56-4409-aadb-702839a8495e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9357bc5c-1d57-4895-baa2-74f006b3e1cc tempest-CinderUnicodeTest-911555230 None] Acquiring lock "cinder-quobyte-ef962a46-bc56-4409-aadb-702839a8495e" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9357bc5c-1d57-4895-baa2-74f006b3e1cc tempest-CinderUnicodeTest-911555230 None] Lock "cinder-quobyte-ef962a46-bc56-4409-aadb-702839a8495e" acquired by "delete_volume" :: waited 0.034s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:31 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2f6403b7-1f01-4867-a3af-37868d5676ff Jul 22 12:25:31 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd53cd0-7c65-4326-91f5-a8941a099107]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9357bc5c-1d57-4895-baa2-74f006b3e1cc tempest-CinderUnicodeTest-911555230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:31 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ed7be24d-de93-4472-8bc0-9b429169081b tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0" returned: 0 in 0.554s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ed7be24d-de93-4472-8bc0-9b429169081b tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.28194be9-0260-40ea-9813-6b03399d66df 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:31 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:31 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:31 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.28194be9-0260-40ea-9813-6b03399d66df 1G Jul 22 12:25:31 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Flow 'volume_create_manager' (b8700967-d2b6-48dd-b31c-5c0d1f26de58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47278224-370e-45cb-9a54-9977b3067e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47278224-370e-45cb-9a54-9977b3067e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2077446798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad0269bf-7557-49d8-998a-7d4497a051c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581a55f7989f49e9a972599c4fb1c9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:32Z,use_quota=True,user_id='e140bae2a094403f9dd9308e21e13abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5678512-4d85-4469-8bb7-22dff63bec91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5678512-4d85-4469-8bb7-22dff63bec91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e61c29d-a11c-4a93-a744-e1316e09b598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e61c29d-a11c-4a93-a744-e1316e09b598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad0269bf-7557-49d8-998a-7d4497a051c5', 'volume_name': 'volume-ad0269bf-7557-49d8-998a-7d4497a051c5', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22373d9-206b-4a04-a8cc-30f09c8c23a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22373d9-206b-4a04-a8cc-30f09c8c23a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19f4df9-bbfb-4aef-828b-a319a3219774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:31 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Volume ad0269bf-7557-49d8-998a-7d4497a051c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad0269bf-7557-49d8-998a-7d4497a051c5', 'volume_size': 1} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:31 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20050b50-1d93-41a2-9475-2505f6022416 tempest-CreateVolumesFromImageTest-405719498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2f6403b7-1f01-4867-a3af-37868d5676ff" returned: 0 in 0.508s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20050b50-1d93-41a2-9475-2505f6022416 tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2f6403b7-1f01-4867-a3af-37868d5676ff {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:32 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2f6403b7-1f01-4867-a3af-37868d5676ff Jul 22 12:25:32 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:32 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9357bc5c-1d57-4895-baa2-74f006b3e1cc tempest-CinderUnicodeTest-911555230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e" returned: 0 in 0.446s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9357bc5c-1d57-4895-baa2-74f006b3e1cc tempest-CinderUnicodeTest-911555230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:32 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e Jul 22 12:25:32 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:32 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:32 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20050b50-1d93-41a2-9475-2505f6022416 tempest-CreateVolumesFromImageTest-405719498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2f6403b7-1f01-4867-a3af-37868d5676ff" returned: 0 in 0.319s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ed7be24d-de93-4472-8bc0-9b429169081b tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.28194be9-0260-40ea-9813-6b03399d66df 1G" returned: 0 in 0.490s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ed7be24d-de93-4472-8bc0-9b429169081b tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.28194be9-0260-40ea-9813-6b03399d66df {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20050b50-1d93-41a2-9475-2505f6022416 tempest-CreateVolumesFromImageTest-405719498 None] Lock "cinder-quobyte-2f6403b7-1f01-4867-a3af-37868d5676ff" released by "delete_volume" :: held 0.881s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:32 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.28194be9-0260-40ea-9813-6b03399d66df Jul 22 12:25:32 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-20050b50-1d93-41a2-9475-2505f6022416 tempest-CreateVolumesFromImageTest-405719498 None] Created reservations ['0d6bc1c8-f086-4f45-81de-cf646a0d5f40', 'af267278-c807-4950-a44d-8d8201e196a8', '8b2fcec8-f5f9-4fb6-954a-f2ae9ad84ef1', 'ef1b4c16-17cb-473d-a3e4-b13b7d1f643e'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-20050b50-1d93-41a2-9475-2505f6022416 tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-20050b50-1d93-41a2-9475-2505f6022416 tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-20050b50-1d93-41a2-9475-2505f6022416 tempest-CreateVolumesFromImageTest-405719498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-20050b50-1d93-41a2-9475-2505f6022416 tempest-CreateVolumesFromImageTest-405719498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-20050b50-1d93-41a2-9475-2505f6022416 tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20050b50-1d93-41a2-9475-2505f6022416 tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:32 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9357bc5c-1d57-4895-baa2-74f006b3e1cc tempest-CinderUnicodeTest-911555230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef962a46-bc56-4409-aadb-702839a8495e" returned: 0 in 0.316s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:32 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:32 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9357bc5c-1d57-4895-baa2-74f006b3e1cc tempest-CinderUnicodeTest-911555230 None] Lock "cinder-quobyte-ef962a46-bc56-4409-aadb-702839a8495e" released by "delete_volume" :: held 0.862s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ca55ea33-1f7c-42c7-91ff-b59b87ff395e tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "cinder-a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ca55ea33-1f7c-42c7-91ff-b59b87ff395e tempest-CreateVolumesFromImageTest-405719498 None] Lock "cinder-a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-9357bc5c-1d57-4895-baa2-74f006b3e1cc tempest-CinderUnicodeTest-911555230 None] Created reservations ['b66a956c-cdfe-43f9-b7f6-203b0a67d8f1', 'caf099d7-59bf-4d01-bdd0-0eed272102fa', '4eeec70e-29fc-4c5f-a37e-011cdd6fd0fe', '085bd4e4-6c7e-4805-b031-4ef3a0b33aff'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ca55ea33-1f7c-42c7-91ff-b59b87ff395e tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "cinder-quobyte-a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:32 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ed7be24d-de93-4472-8bc0-9b429169081b tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.28194be9-0260-40ea-9813-6b03399d66df" returned: 0 in 0.400s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:32 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-ed7be24d-de93-4472-8bc0-9b429169081b tempest-ProjectMemberTests-872887571 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.28194be9-0260-40ea-9813-6b03399d66df is being set with open permissions: ugo+rw Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ed7be24d-de93-4472-8bc0-9b429169081b tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.28194be9-0260-40ea-9813-6b03399d66df {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:32 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ca55ea33-1f7c-42c7-91ff-b59b87ff395e tempest-CreateVolumesFromImageTest-405719498 None] Lock "cinder-quobyte-a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0" acquired by "delete_volume" :: waited 0.066s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:32 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.28194be9-0260-40ea-9813-6b03399d66df Jul 22 12:25:32 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ac589822-6795-4a1a-8dff-f18510d49bd1 tempest-CinderUnicodeTest-911555230 None] Acquiring lock "cinder-9d77cade-da5f-4267-ab56-63dac9a15808-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20050b50-1d93-41a2-9475-2505f6022416 tempest-CreateVolumesFromImageTest-405719498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.321s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-20050b50-1d93-41a2-9475-2505f6022416 tempest-CreateVolumesFromImageTest-405719498 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2524bf2-6764-4759-9e80-faa3e173d3f3]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ca55ea33-1f7c-42c7-91ff-b59b87ff395e tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:32 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-20050b50-1d93-41a2-9475-2505f6022416 tempest-CreateVolumesFromImageTest-405719498 None] Deleted volume successfully. Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9357bc5c-1d57-4895-baa2-74f006b3e1cc tempest-CinderUnicodeTest-911555230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9357bc5c-1d57-4895-baa2-74f006b3e1cc tempest-CinderUnicodeTest-911555230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9357bc5c-1d57-4895-baa2-74f006b3e1cc tempest-CinderUnicodeTest-911555230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9357bc5c-1d57-4895-baa2-74f006b3e1cc tempest-CinderUnicodeTest-911555230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9357bc5c-1d57-4895-baa2-74f006b3e1cc tempest-CinderUnicodeTest-911555230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9357bc5c-1d57-4895-baa2-74f006b3e1cc tempest-CinderUnicodeTest-911555230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ac589822-6795-4a1a-8dff-f18510d49bd1 tempest-CinderUnicodeTest-911555230 None] Lock "cinder-9d77cade-da5f-4267-ab56-63dac9a15808-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:32 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:32 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-20050b50-1d93-41a2-9475-2505f6022416 tempest-CreateVolumesFromImageTest-405719498 None] Lock "cinder-2f6403b7-1f01-4867-a3af-37868d5676ff-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ac589822-6795-4a1a-8dff-f18510d49bd1 tempest-CinderUnicodeTest-911555230 None] Acquiring lock "cinder-quobyte-9d77cade-da5f-4267-ab56-63dac9a15808" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:32 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0 Jul 22 12:25:32 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ac589822-6795-4a1a-8dff-f18510d49bd1 tempest-CinderUnicodeTest-911555230 None] Lock "cinder-quobyte-9d77cade-da5f-4267-ab56-63dac9a15808" acquired by "delete_volume" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[12413ec2-5042-4810-9d2b-35cea975e391]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ac589822-6795-4a1a-8dff-f18510d49bd1 tempest-CinderUnicodeTest-911555230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d77cade-da5f-4267-ab56-63dac9a15808 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:33 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ed7be24d-de93-4472-8bc0-9b429169081b tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.28194be9-0260-40ea-9813-6b03399d66df" returned: 0 in 0.346s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ed7be24d-de93-4472-8bc0-9b429169081b tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:33 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d77cade-da5f-4267-ab56-63dac9a15808 Jul 22 12:25:33 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:33 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.info Jul 22 12:25:33 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:33 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9357bc5c-1d57-4895-baa2-74f006b3e1cc tempest-CinderUnicodeTest-911555230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.299s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-9357bc5c-1d57-4895-baa2-74f006b3e1cc tempest-CinderUnicodeTest-911555230 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:33 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-9357bc5c-1d57-4895-baa2-74f006b3e1cc tempest-CinderUnicodeTest-911555230 None] Deleted volume successfully. Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-9357bc5c-1d57-4895-baa2-74f006b3e1cc tempest-CinderUnicodeTest-911555230 None] Lock "cinder-ef962a46-bc56-4409-aadb-702839a8495e-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:33 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ca55ea33-1f7c-42c7-91ff-b59b87ff395e tempest-CreateVolumesFromImageTest-405719498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0" returned: 0 in 0.457s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ca55ea33-1f7c-42c7-91ff-b59b87ff395e tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:33 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0 Jul 22 12:25:33 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:33 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ed7be24d-de93-4472-8bc0-9b429169081b tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.info" returned: 0 in 0.296s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:33 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-ed7be24d-de93-4472-8bc0-9b429169081b tempest-ProjectMemberTests-872887571 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.info is being set with open permissions: ugo+rw Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ed7be24d-de93-4472-8bc0-9b429169081b tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:33 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ac589822-6795-4a1a-8dff-f18510d49bd1 tempest-CinderUnicodeTest-911555230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d77cade-da5f-4267-ab56-63dac9a15808" returned: 0 in 0.425s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ac589822-6795-4a1a-8dff-f18510d49bd1 tempest-CinderUnicodeTest-911555230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d77cade-da5f-4267-ab56-63dac9a15808 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:33 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.info Jul 22 12:25:33 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:33 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d77cade-da5f-4267-ab56-63dac9a15808 Jul 22 12:25:33 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:33 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ca55ea33-1f7c-42c7-91ff-b59b87ff395e tempest-CreateVolumesFromImageTest-405719498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0" returned: 0 in 0.274s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ca55ea33-1f7c-42c7-91ff-b59b87ff395e tempest-CreateVolumesFromImageTest-405719498 None] Lock "cinder-quobyte-a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0" released by "delete_volume" :: held 0.788s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-ca55ea33-1f7c-42c7-91ff-b59b87ff395e tempest-CreateVolumesFromImageTest-405719498 None] Created reservations ['b4b9e603-b749-4e11-b222-4c56ec4e7440', '3b5a39f6-1f52-4b94-89cb-59aee759c904', '10b4478d-eaf3-4685-b9a9-29e2b4f7736c', 'd178926c-e355-4152-a166-183b876a8016'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ca55ea33-1f7c-42c7-91ff-b59b87ff395e tempest-CreateVolumesFromImageTest-405719498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ca55ea33-1f7c-42c7-91ff-b59b87ff395e tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ca55ea33-1f7c-42c7-91ff-b59b87ff395e tempest-CreateVolumesFromImageTest-405719498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ca55ea33-1f7c-42c7-91ff-b59b87ff395e tempest-CreateVolumesFromImageTest-405719498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ca55ea33-1f7c-42c7-91ff-b59b87ff395e tempest-CreateVolumesFromImageTest-405719498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ca55ea33-1f7c-42c7-91ff-b59b87ff395e tempest-CreateVolumesFromImageTest-405719498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:33 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ed7be24d-de93-4472-8bc0-9b429169081b tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.info" returned: 0 in 0.279s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:33 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:33 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ed7be24d-de93-4472-8bc0-9b429169081b tempest-ProjectMemberTests-872887571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.482s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:33 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.772s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2077446798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad0269bf-7557-49d8-998a-7d4497a051c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581a55f7989f49e9a972599c4fb1c9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:32Z,use_quota=True,user_id='e140bae2a094403f9dd9308e21e13abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Creating volume ad0269bf-7557-49d8-998a-7d4497a051c5 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:33 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ad0269bf-7557-49d8-998a-7d4497a051c5 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ac589822-6795-4a1a-8dff-f18510d49bd1 tempest-CinderUnicodeTest-911555230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d77cade-da5f-4267-ab56-63dac9a15808" returned: 0 in 0.319s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:33 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ad0269bf-7557-49d8-998a-7d4497a051c5 1073741824 Jul 22 12:25:33 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ac589822-6795-4a1a-8dff-f18510d49bd1 tempest-CinderUnicodeTest-911555230 None] Lock "cinder-quobyte-9d77cade-da5f-4267-ab56-63dac9a15808" released by "delete_volume" :: held 0.813s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:33 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-ed7be24d-de93-4472-8bc0-9b429169081b tempest-ProjectMemberTests-872887571 None] Create snapshot completed successfully Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-ac589822-6795-4a1a-8dff-f18510d49bd1 tempest-CinderUnicodeTest-911555230 None] Created reservations ['bf365c92-b1f9-49f8-835e-436f7f16450b', '1e4eeeb5-ee1b-4f83-8814-dc8a24cdc639', '55056b83-d039-4a3e-a95d-7669ddfce14a', 'f7072473-ba50-44d1-9e46-8edf05e2cae4'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ac589822-6795-4a1a-8dff-f18510d49bd1 tempest-CinderUnicodeTest-911555230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ac589822-6795-4a1a-8dff-f18510d49bd1 tempest-CinderUnicodeTest-911555230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ac589822-6795-4a1a-8dff-f18510d49bd1 tempest-CinderUnicodeTest-911555230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ac589822-6795-4a1a-8dff-f18510d49bd1 tempest-CinderUnicodeTest-911555230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ac589822-6795-4a1a-8dff-f18510d49bd1 tempest-CinderUnicodeTest-911555230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ac589822-6795-4a1a-8dff-f18510d49bd1 tempest-CinderUnicodeTest-911555230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:33 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:33 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:33 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ca55ea33-1f7c-42c7-91ff-b59b87ff395e tempest-CreateVolumesFromImageTest-405719498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.339s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-ca55ea33-1f7c-42c7-91ff-b59b87ff395e tempest-CreateVolumesFromImageTest-405719498 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:34 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-ca55ea33-1f7c-42c7-91ff-b59b87ff395e tempest-CreateVolumesFromImageTest-405719498 None] Deleted volume successfully. Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ca55ea33-1f7c-42c7-91ff-b59b87ff395e tempest-CreateVolumesFromImageTest-405719498 None] Lock "cinder-a68f8c22-42b9-41ba-88ee-fb60f3f8e1a0-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:34 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ac589822-6795-4a1a-8dff-f18510d49bd1 tempest-CinderUnicodeTest-911555230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.381s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-ac589822-6795-4a1a-8dff-f18510d49bd1 tempest-CinderUnicodeTest-911555230 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:34 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-ac589822-6795-4a1a-8dff-f18510d49bd1 tempest-CinderUnicodeTest-911555230 None] Deleted volume successfully. Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ac589822-6795-4a1a-8dff-f18510d49bd1 tempest-CinderUnicodeTest-911555230 None] Lock "cinder-9d77cade-da5f-4267-ab56-63dac9a15808-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:34 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ad0269bf-7557-49d8-998a-7d4497a051c5 1073741824" returned: 0 in 0.696s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ad0269bf-7557-49d8-998a-7d4497a051c5 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-359d6823-3a59-4326-a7e8-e6d3de832c1e tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-28194be9-0260-40ea-9813-6b03399d66df-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:34 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ad0269bf-7557-49d8-998a-7d4497a051c5 Jul 22 12:25:34 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-359d6823-3a59-4326-a7e8-e6d3de832c1e tempest-ProjectMemberTests-872887571 None] Lock "cinder-28194be9-0260-40ea-9813-6b03399d66df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-359d6823-3a59-4326-a7e8-e6d3de832c1e tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-9d4e7491-568f-43d3-8b76-1b98bdd702f0" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-359d6823-3a59-4326-a7e8-e6d3de832c1e tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-9d4e7491-568f-43d3-8b76-1b98bdd702f0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-359d6823-3a59-4326-a7e8-e6d3de832c1e tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-28194be9-0260-40ea-9813-6b03399d66df" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-359d6823-3a59-4326-a7e8-e6d3de832c1e tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-28194be9-0260-40ea-9813-6b03399d66df" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-359d6823-3a59-4326-a7e8-e6d3de832c1e tempest-ProjectMemberTests-872887571 None] Deleting offline snapshot 28194be9-0260-40ea-9813-6b03399d66df of volume 9d4e7491-568f-43d3-8b76-1b98bdd702f0 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-359d6823-3a59-4326-a7e8-e6d3de832c1e tempest-ProjectMemberTests-872887571 None] snapshot_file for this snap is: volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.28194be9-0260-40ea-9813-6b03399d66df {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da865a3-7ed5-4f05-a744-7703df1bd14b]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-359d6823-3a59-4326-a7e8-e6d3de832c1e tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.28194be9-0260-40ea-9813-6b03399d66df {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:34 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ad0269bf-7557-49d8-998a-7d4497a051c5" returned: 0 in 0.293s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:34 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.28194be9-0260-40ea-9813-6b03399d66df Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:34 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19f4df9-bbfb-4aef-828b-a319a3219774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad0269bf-7557-49d8-998a-7d4497a051c5', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58414029-f485-476f-8493-973560d70cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:34 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Volume volume-ad0269bf-7557-49d8-998a-7d4497a051c5 (ad0269bf-7557-49d8-998a-7d4497a051c5): created successfully Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58414029-f485-476f-8493-973560d70cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Flow 'volume_create_manager' (b8700967-d2b6-48dd-b31c-5c0d1f26de58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:34 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-20ead520-aaee-4c9c-981a-34ff5aec7820 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Created volume successfully. Jul 22 12:25:35 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-359d6823-3a59-4326-a7e8-e6d3de832c1e tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.28194be9-0260-40ea-9813-6b03399d66df" returned: 0 in 0.503s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-359d6823-3a59-4326-a7e8-e6d3de832c1e tempest-ProjectMemberTests-872887571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b245e4e4-2d46-4eb2-8531-9e1c3c4fcd6b]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-359d6823-3a59-4326-a7e8-e6d3de832c1e tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:35 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0 Jul 22 12:25:35 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:35 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-359d6823-3a59-4326-a7e8-e6d3de832c1e tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0" returned: 0 in 0.543s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-359d6823-3a59-4326-a7e8-e6d3de832c1e tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.28194be9-0260-40ea-9813-6b03399d66df {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:35 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.28194be9-0260-40ea-9813-6b03399d66df Jul 22 12:25:35 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Flow 'volume_create_manager' (3fca492f-b99d-4071-93ec-9a65e0b91cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db78d076-abe1-481f-915f-959de2399d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db78d076-abe1-481f-915f-959de2399d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1262835586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be66bd7-2911-4b85-8e29-48b61b221ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581a55f7989f49e9a972599c4fb1c9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:36Z,use_quota=True,user_id='e140bae2a094403f9dd9308e21e13abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (050067b9-840d-45bd-bf44-9c3a0a2f65f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (050067b9-840d-45bd-bf44-9c3a0a2f65f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5a26e7-1fcb-4f46-87c3-6476ba01eaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5a26e7-1fcb-4f46-87c3-6476ba01eaf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5be66bd7-2911-4b85-8e29-48b61b221ceb', 'volume_name': 'volume-5be66bd7-2911-4b85-8e29-48b61b221ceb', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb12075-9fbe-4fc5-9e1d-672c65a7c9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb12075-9fbe-4fc5-9e1d-672c65a7c9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a14b11c-4e02-46a4-8b8f-c6d6c5d56996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:35 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Volume 5be66bd7-2911-4b85-8e29-48b61b221ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5be66bd7-2911-4b85-8e29-48b61b221ceb', 'volume_size': 1} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1262835586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be66bd7-2911-4b85-8e29-48b61b221ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581a55f7989f49e9a972599c4fb1c9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:36Z,use_quota=True,user_id='e140bae2a094403f9dd9308e21e13abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Creating volume 5be66bd7-2911-4b85-8e29-48b61b221ceb {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:35 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5be66bd7-2911-4b85-8e29-48b61b221ceb 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:35 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5be66bd7-2911-4b85-8e29-48b61b221ceb 1073741824 Jul 22 12:25:35 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:36 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Flow 'volume_create_manager' (afb097c7-1ef2-4951-aa5b-7adafa17ee2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e51b489-b0c8-4bd4-a589-e8043bbb2f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e51b489-b0c8-4bd4-a589-e8043bbb2f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1538432209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f642ec-fea8-4954-9e6b-6ffd4d022dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581a55f7989f49e9a972599c4fb1c9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:36Z,use_quota=True,user_id='e140bae2a094403f9dd9308e21e13abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2b43d6-49aa-4c01-91a4-93187deb5154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:36 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2b43d6-49aa-4c01-91a4-93187deb5154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d982fb-12d2-4bcc-b97d-c943d9ed20cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d982fb-12d2-4bcc-b97d-c943d9ed20cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91f642ec-fea8-4954-9e6b-6ffd4d022dd7', 'volume_name': 'volume-91f642ec-fea8-4954-9e6b-6ffd4d022dd7', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82d5cb2b-2a29-4a89-a18e-4bc8e048d510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82d5cb2b-2a29-4a89-a18e-4bc8e048d510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:36 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d317244-a445-419e-afe0-3678883bd7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:36 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Volume 91f642ec-fea8-4954-9e6b-6ffd4d022dd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91f642ec-fea8-4954-9e6b-6ffd4d022dd7', 'volume_size': 1} Jul 22 12:25:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-359d6823-3a59-4326-a7e8-e6d3de832c1e tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.28194be9-0260-40ea-9813-6b03399d66df" returned: 0 in 0.753s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-359d6823-3a59-4326-a7e8-e6d3de832c1e tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.28194be9-0260-40ea-9813-6b03399d66df {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:36 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.28194be9-0260-40ea-9813-6b03399d66df Jul 22 12:25:36 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:36 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5be66bd7-2911-4b85-8e29-48b61b221ceb 1073741824" returned: 0 in 0.810s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5be66bd7-2911-4b85-8e29-48b61b221ceb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:36 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5be66bd7-2911-4b85-8e29-48b61b221ceb Jul 22 12:25:36 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:36 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-359d6823-3a59-4326-a7e8-e6d3de832c1e tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0.28194be9-0260-40ea-9813-6b03399d66df" returned: 0 in 0.508s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-359d6823-3a59-4326-a7e8-e6d3de832c1e tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-28194be9-0260-40ea-9813-6b03399d66df" released by "_delete_snapshot" :: held 2.477s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Flow 'volume_create_manager' (1096b5e9-6bba-4b5c-bb84-7ea1e6c4e929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b72534-0f92-4d54-b45b-7dbde26d1741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-359d6823-3a59-4326-a7e8-e6d3de832c1e tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-9d4e7491-568f-43d3-8b76-1b98bdd702f0" released by "delete_snapshot" :: held 2.632s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:37 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b72534-0f92-4d54-b45b-7dbde26d1741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1379998667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c04d53-fe79-4337-aa69-5e4dc110e9c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581a55f7989f49e9a972599c4fb1c9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:37Z,use_quota=True,user_id='e140bae2a094403f9dd9308e21e13abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f99abe9-fe7c-40ab-8658-7d8ae32fcb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f99abe9-fe7c-40ab-8658-7d8ae32fcb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f400382-e2f5-4623-9acf-c04ea29e8abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f400382-e2f5-4623-9acf-c04ea29e8abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41c04d53-fe79-4337-aa69-5e4dc110e9c3', 'volume_name': 'volume-41c04d53-fe79-4337-aa69-5e4dc110e9c3', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d66b76e-1614-496e-9f77-b26b71cfcea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d66b76e-1614-496e-9f77-b26b71cfcea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12b0f020-ffed-44f8-b70b-94a13e038cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:37 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Volume 41c04d53-fe79-4337-aa69-5e4dc110e9c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41c04d53-fe79-4337-aa69-5e4dc110e9c3', 'volume_size': 1} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5be66bd7-2911-4b85-8e29-48b61b221ceb" returned: 0 in 0.498s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.880s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1538432209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f642ec-fea8-4954-9e6b-6ffd4d022dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581a55f7989f49e9a972599c4fb1c9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:36Z,use_quota=True,user_id='e140bae2a094403f9dd9308e21e13abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Creating volume 91f642ec-fea8-4954-9e6b-6ffd4d022dd7 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:37 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-91f642ec-fea8-4954-9e6b-6ffd4d022dd7 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:37 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-91f642ec-fea8-4954-9e6b-6ffd4d022dd7 1073741824 Jul 22 12:25:37 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a14b11c-4e02-46a4-8b8f-c6d6c5d56996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5be66bd7-2911-4b85-8e29-48b61b221ceb', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a1409f-f60d-448a-92cb-bd7f11ae8bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Flow 'volume_create_manager' (75f151ef-74d4-4117-96b7-db94aacfdb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc55f0f-8335-4df7-8560-5794debc0abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:37 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Volume volume-5be66bd7-2911-4b85-8e29-48b61b221ceb (5be66bd7-2911-4b85-8e29-48b61b221ceb): created successfully Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a1409f-f60d-448a-92cb-bd7f11ae8bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Flow 'volume_create_manager' (3fca492f-b99d-4071-93ec-9a65e0b91cec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-359d6823-3a59-4326-a7e8-e6d3de832c1e tempest-ProjectMemberTests-872887571 None] Created reservations ['01beb94e-aa2e-4f72-a5ae-efe76da7f421', '64133079-8966-43d4-b048-175c6ea2cc9a', '5a9c9236-2bdd-49e1-baf4-d090bfb3f449', '01af094c-2434-4047-b990-56efb0728864'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc55f0f-8335-4df7-8560-5794debc0abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-116563086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e96042-188d-430c-8b02-9f622678c99b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581a55f7989f49e9a972599c4fb1c9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:37Z,use_quota=True,user_id='e140bae2a094403f9dd9308e21e13abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125fd967-4b05-4928-92d8-274d53040132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125fd967-4b05-4928-92d8-274d53040132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cd045f-27f3-407a-97d6-41939b956b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cd045f-27f3-407a-97d6-41939b956b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3e96042-188d-430c-8b02-9f622678c99b', 'volume_name': 'volume-b3e96042-188d-430c-8b02-9f622678c99b', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87dcf1ce-96a6-45e3-bc63-3ffc8587a328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87dcf1ce-96a6-45e3-bc63-3ffc8587a328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14f1425e-f950-4a84-8ffb-2b65336110a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:37 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Volume b3e96042-188d-430c-8b02-9f622678c99b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3e96042-188d-430c-8b02-9f622678c99b', 'volume_size': 1} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:37 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-4647ab95-210f-4fec-8e0d-bfeab253d316 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Created volume successfully. Jul 22 12:25:37 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-359d6823-3a59-4326-a7e8-e6d3de832c1e tempest-ProjectMemberTests-872887571 None] Delete snapshot completed successfully. Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-359d6823-3a59-4326-a7e8-e6d3de832c1e tempest-ProjectMemberTests-872887571 None] Lock "cinder-28194be9-0260-40ea-9813-6b03399d66df-delete_snapshot" released by "delete_snapshot" :: held 3.303s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8d5c9b24-ed50-46d5-8cbb-d75abaa996df tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-9d4e7491-568f-43d3-8b76-1b98bdd702f0-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8d5c9b24-ed50-46d5-8cbb-d75abaa996df tempest-ProjectMemberTests-872887571 None] Lock "cinder-9d4e7491-568f-43d3-8b76-1b98bdd702f0-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Flow 'volume_create_manager' (f3bb724e-d75b-404d-94a8-1d02cfacc9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:38 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca7c222-f2ad-4cc7-ab18-b37ba07083b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-91f642ec-fea8-4954-9e6b-6ffd4d022dd7 1073741824" returned: 0 in 0.748s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca7c222-f2ad-4cc7-ab18-b37ba07083b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1601183776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa689a47-66a8-425c-8825-4421e95cbd12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581a55f7989f49e9a972599c4fb1c9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:38Z,use_quota=True,user_id='e140bae2a094403f9dd9308e21e13abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41fa6fc9-d326-43ca-8d29-a3cf3f71de8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41fa6fc9-d326-43ca-8d29-a3cf3f71de8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5809f870-d833-465b-bd1b-eb6d6a360bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5809f870-d833-465b-bd1b-eb6d6a360bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa689a47-66a8-425c-8825-4421e95cbd12', 'volume_name': 'volume-aa689a47-66a8-425c-8825-4421e95cbd12', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5691ac-075d-41c7-aa96-b43b4a239b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5691ac-075d-41c7-aa96-b43b4a239b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83db442-77c8-440e-82d6-176a8c446b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:38 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Volume aa689a47-66a8-425c-8825-4421e95cbd12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa689a47-66a8-425c-8825-4421e95cbd12', 'volume_size': 1} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8d5c9b24-ed50-46d5-8cbb-d75abaa996df tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-9d4e7491-568f-43d3-8b76-1b98bdd702f0" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-91f642ec-fea8-4954-9e6b-6ffd4d022dd7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8d5c9b24-ed50-46d5-8cbb-d75abaa996df tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-9d4e7491-568f-43d3-8b76-1b98bdd702f0" acquired by "delete_volume" :: waited 0.043s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:38 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-91f642ec-fea8-4954-9e6b-6ffd4d022dd7 Jul 22 12:25:38 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82f93d6-75a6-4a3a-ae8e-1e4b1f25646c]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8d5c9b24-ed50-46d5-8cbb-d75abaa996df tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:38 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0 Jul 22 12:25:38 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Flow 'volume_create_manager' (dde33775-9676-43ee-8229-68be9614efc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d95be8-d157-48a7-9224-83ddd0cafb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:38 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-91f642ec-fea8-4954-9e6b-6ffd4d022dd7" returned: 0 in 0.387s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.318s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1379998667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c04d53-fe79-4337-aa69-5e4dc110e9c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581a55f7989f49e9a972599c4fb1c9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:37Z,use_quota=True,user_id='e140bae2a094403f9dd9308e21e13abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Creating volume 41c04d53-fe79-4337-aa69-5e4dc110e9c3 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:38 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-41c04d53-fe79-4337-aa69-5e4dc110e9c3 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d95be8-d157-48a7-9224-83ddd0cafb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2144702001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a925706e-658d-4e3e-9f05-9a3096f15747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a72f95b1ab4678a7ea3f9ca98b84a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:38Z,use_quota=True,user_id='e7c12e9bfe144ee5ad31754dbe515910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8078c81-8a1c-4418-aca0-380701f33201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:38 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-41c04d53-fe79-4337-aa69-5e4dc110e9c3 1073741824 Jul 22 12:25:38 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8078c81-8a1c-4418-aca0-380701f33201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb001161-8d6d-4d31-a903-1790bf5405c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb001161-8d6d-4d31-a903-1790bf5405c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a925706e-658d-4e3e-9f05-9a3096f15747', 'volume_name': 'volume-a925706e-658d-4e3e-9f05-9a3096f15747', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981e4227-facc-48b0-9127-64e4211050f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981e4227-facc-48b0-9127-64e4211050f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f630f1bd-3abe-4925-ae93-4124299e24ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:38 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Volume a925706e-658d-4e3e-9f05-9a3096f15747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a925706e-658d-4e3e-9f05-9a3096f15747', 'volume_size': 1} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d317244-a445-419e-afe0-3678883bd7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91f642ec-fea8-4954-9e6b-6ffd4d022dd7', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849859df-e906-4d82-a212-7db166ead3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:38 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Volume volume-91f642ec-fea8-4954-9e6b-6ffd4d022dd7 (91f642ec-fea8-4954-9e6b-6ffd4d022dd7): created successfully Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849859df-e906-4d82-a212-7db166ead3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Flow 'volume_create_manager' (afb097c7-1ef2-4951-aa5b-7adafa17ee2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:38 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-577b4dd2-3430-457f-8203-3abae77e1b17 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Created volume successfully. Jul 22 12:25:38 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8d5c9b24-ed50-46d5-8cbb-d75abaa996df tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0" returned: 0 in 0.474s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8d5c9b24-ed50-46d5-8cbb-d75abaa996df tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:38 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0 Jul 22 12:25:38 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-2ff4f636-94d8-4b82-9cc4-06d29851889c tempest-ProjectAdminTests-294587850 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6803550720215, 'free_capacity_gb': 1775.6803550720215, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87568) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 22 12:25:39 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8d5c9b24-ed50-46d5-8cbb-d75abaa996df tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9d4e7491-568f-43d3-8b76-1b98bdd702f0" returned: 0 in 0.282s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8d5c9b24-ed50-46d5-8cbb-d75abaa996df tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-9d4e7491-568f-43d3-8b76-1b98bdd702f0" released by "delete_volume" :: held 0.851s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:39 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-41c04d53-fe79-4337-aa69-5e4dc110e9c3 1073741824" returned: 0 in 0.505s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-8d5c9b24-ed50-46d5-8cbb-d75abaa996df tempest-ProjectMemberTests-872887571 None] Created reservations ['2e69387a-28e5-4ad2-9e79-3a6da1100ffc', 'de195589-bd08-4d2f-8d26-5786f6c7cea5', 'd3109fef-3f2e-49cc-aab9-3913c71fb690', 'b652db0e-37a7-4e79-8402-a1b9e9f96d7e'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-41c04d53-fe79-4337-aa69-5e4dc110e9c3 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:39 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-41c04d53-fe79-4337-aa69-5e4dc110e9c3 Jul 22 12:25:39 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8d5c9b24-ed50-46d5-8cbb-d75abaa996df tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8d5c9b24-ed50-46d5-8cbb-d75abaa996df tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8d5c9b24-ed50-46d5-8cbb-d75abaa996df tempest-ProjectMemberTests-872887571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8d5c9b24-ed50-46d5-8cbb-d75abaa996df tempest-ProjectMemberTests-872887571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8d5c9b24-ed50-46d5-8cbb-d75abaa996df tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8d5c9b24-ed50-46d5-8cbb-d75abaa996df tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:39 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:39 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:39 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-41c04d53-fe79-4337-aa69-5e4dc110e9c3" returned: 0 in 0.296s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.867s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-116563086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e96042-188d-430c-8b02-9f622678c99b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581a55f7989f49e9a972599c4fb1c9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:37Z,use_quota=True,user_id='e140bae2a094403f9dd9308e21e13abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Creating volume b3e96042-188d-430c-8b02-9f622678c99b {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:39 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b3e96042-188d-430c-8b02-9f622678c99b 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12b0f020-ffed-44f8-b70b-94a13e038cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41c04d53-fe79-4337-aa69-5e4dc110e9c3', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f519f477-80c7-4cd0-a9fa-f95b9cc54efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:39 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b3e96042-188d-430c-8b02-9f622678c99b 1073741824 Jul 22 12:25:39 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:39 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Volume volume-41c04d53-fe79-4337-aa69-5e4dc110e9c3 (41c04d53-fe79-4337-aa69-5e4dc110e9c3): created successfully Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f519f477-80c7-4cd0-a9fa-f95b9cc54efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Flow 'volume_create_manager' (1096b5e9-6bba-4b5c-bb84-7ea1e6c4e929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:39 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-aaf7cc2a-fcb7-4a16-a6d0-d42634f3c712 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Created volume successfully. Jul 22 12:25:39 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8d5c9b24-ed50-46d5-8cbb-d75abaa996df tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.301s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-8d5c9b24-ed50-46d5-8cbb-d75abaa996df tempest-ProjectMemberTests-872887571 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:39 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-8d5c9b24-ed50-46d5-8cbb-d75abaa996df tempest-ProjectMemberTests-872887571 None] Deleted volume successfully. Jul 22 12:25:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8d5c9b24-ed50-46d5-8cbb-d75abaa996df tempest-ProjectMemberTests-872887571 None] Lock "cinder-9d4e7491-568f-43d3-8b76-1b98bdd702f0-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:40 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b3e96042-188d-430c-8b02-9f622678c99b 1073741824" returned: 0 in 0.467s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b3e96042-188d-430c-8b02-9f622678c99b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:40 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b3e96042-188d-430c-8b02-9f622678c99b Jul 22 12:25:40 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:40 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b3e96042-188d-430c-8b02-9f622678c99b" returned: 0 in 0.317s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.170s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1601183776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa689a47-66a8-425c-8825-4421e95cbd12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581a55f7989f49e9a972599c4fb1c9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:38Z,use_quota=True,user_id='e140bae2a094403f9dd9308e21e13abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Creating volume aa689a47-66a8-425c-8825-4421e95cbd12 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:40 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa689a47-66a8-425c-8825-4421e95cbd12 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14f1425e-f950-4a84-8ffb-2b65336110a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3e96042-188d-430c-8b02-9f622678c99b', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf14b03-50d0-42e5-93f8-432ee3018e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:40 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa689a47-66a8-425c-8825-4421e95cbd12 1073741824 Jul 22 12:25:40 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:40 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Volume volume-b3e96042-188d-430c-8b02-9f622678c99b (b3e96042-188d-430c-8b02-9f622678c99b): created successfully Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf14b03-50d0-42e5-93f8-432ee3018e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Flow 'volume_create_manager' (75f151ef-74d4-4117-96b7-db94aacfdb36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:40 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-211847ef-f8e1-44bc-b300-882ed2c0cad2 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Created volume successfully. Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Flow 'volume_create_manager' (f9e26cc1-895d-499e-837a-ab23ab5d44e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb4b85c-5b18-4484-a3f1-e4b65fbbd630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb4b85c-5b18-4484-a3f1-e4b65fbbd630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1642366370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61eb478d-3884-4537-b0e8-2bf0ada1ccf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89707e5757184c76b39c42c3553f59c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:41Z,use_quota=True,user_id='edd7857f9fd44201b44894c8b9b98d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe9e668-834f-4513-aabf-f1171b0a3340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe9e668-834f-4513-aabf-f1171b0a3340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3760431-3733-491c-9e64-942098d8e4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3760431-3733-491c-9e64-942098d8e4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61eb478d-3884-4537-b0e8-2bf0ada1ccf9', 'volume_name': 'volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df382ee3-02ba-4ef3-af52-9e1b9c8b56b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df382ee3-02ba-4ef3-af52-9e1b9c8b56b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8427a6-4d8e-44a5-b3c7-73f0736448dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:40 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Volume 61eb478d-3884-4537-b0e8-2bf0ada1ccf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9', 'volume_size': 1} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:40 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa689a47-66a8-425c-8825-4421e95cbd12 1073741824" returned: 0 in 0.570s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa689a47-66a8-425c-8825-4421e95cbd12 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:41 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa689a47-66a8-425c-8825-4421e95cbd12 Jul 22 12:25:41 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:41 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa689a47-66a8-425c-8825-4421e95cbd12" returned: 0 in 0.251s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.530s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2144702001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a925706e-658d-4e3e-9f05-9a3096f15747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a72f95b1ab4678a7ea3f9ca98b84a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:38Z,use_quota=True,user_id='e7c12e9bfe144ee5ad31754dbe515910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Creating volume a925706e-658d-4e3e-9f05-9a3096f15747 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:41 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83db442-77c8-440e-82d6-176a8c446b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa689a47-66a8-425c-8825-4421e95cbd12', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a566f0d3-9869-40b8-9327-9179bd8db6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:41 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747 1073741824 Jul 22 12:25:41 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:41 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Volume volume-aa689a47-66a8-425c-8825-4421e95cbd12 (aa689a47-66a8-425c-8825-4421e95cbd12): created successfully Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a566f0d3-9869-40b8-9327-9179bd8db6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Flow 'volume_create_manager' (f3bb724e-d75b-404d-94a8-1d02cfacc9e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:41 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-8d89f151-c1f4-4b79-a88f-6d8e928b19df tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Created volume successfully. Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5b97afd9-1d49-4b28-a1cb-95d422cec05b tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "cinder-aa689a47-66a8-425c-8825-4421e95cbd12-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5b97afd9-1d49-4b28-a1cb-95d422cec05b tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-aa689a47-66a8-425c-8825-4421e95cbd12-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5b97afd9-1d49-4b28-a1cb-95d422cec05b tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "cinder-quobyte-aa689a47-66a8-425c-8825-4421e95cbd12" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5b97afd9-1d49-4b28-a1cb-95d422cec05b tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-quobyte-aa689a47-66a8-425c-8825-4421e95cbd12" acquired by "delete_volume" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f790313b-1398-4a2e-9faf-6ab8c144cc9b]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5b97afd9-1d49-4b28-a1cb-95d422cec05b tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa689a47-66a8-425c-8825-4421e95cbd12 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:41 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747 1073741824" returned: 0 in 0.541s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:41 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747 Jul 22 12:25:41 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:41 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa689a47-66a8-425c-8825-4421e95cbd12 Jul 22 12:25:41 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:42 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747" returned: 0 in 0.261s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.154s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1642366370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61eb478d-3884-4537-b0e8-2bf0ada1ccf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89707e5757184c76b39c42c3553f59c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:41Z,use_quota=True,user_id='edd7857f9fd44201b44894c8b9b98d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Creating volume 61eb478d-3884-4537-b0e8-2bf0ada1ccf9 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:42 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f630f1bd-3abe-4925-ae93-4124299e24ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a925706e-658d-4e3e-9f05-9a3096f15747', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:42 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9 1073741824 Jul 22 12:25:42 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b80c02ee-6f1f-42fc-b44d-ea9e3cf804a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:42 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Volume volume-a925706e-658d-4e3e-9f05-9a3096f15747 (a925706e-658d-4e3e-9f05-9a3096f15747): created successfully Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b80c02ee-6f1f-42fc-b44d-ea9e3cf804a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Flow 'volume_create_manager' (dde33775-9676-43ee-8229-68be9614efc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:42 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-de7afdae-fe25-480d-a833-38d040bc57ba tempest-VolumeDependencyTests-1587930118 None] Created volume successfully. Jul 22 12:25:42 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5b97afd9-1d49-4b28-a1cb-95d422cec05b tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa689a47-66a8-425c-8825-4421e95cbd12" returned: 0 in 0.458s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5b97afd9-1d49-4b28-a1cb-95d422cec05b tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa689a47-66a8-425c-8825-4421e95cbd12 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:42 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa689a47-66a8-425c-8825-4421e95cbd12 Jul 22 12:25:42 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:42 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5b97afd9-1d49-4b28-a1cb-95d422cec05b tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa689a47-66a8-425c-8825-4421e95cbd12" returned: 0 in 0.286s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5b97afd9-1d49-4b28-a1cb-95d422cec05b tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-quobyte-aa689a47-66a8-425c-8825-4421e95cbd12" released by "delete_volume" :: held 0.797s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-5b97afd9-1d49-4b28-a1cb-95d422cec05b tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Created reservations ['8ec8a1cf-1982-409c-91b5-709741eb0326', '78d7118e-1bee-481e-98dc-c8387cb1d22d', 'aae2f720-d6f4-412a-bd23-a7e585ae2821', 'f1027703-ca3f-459b-afbf-0a21e6d76165'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:42 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9 1073741824" returned: 0 in 0.530s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5b97afd9-1d49-4b28-a1cb-95d422cec05b tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5b97afd9-1d49-4b28-a1cb-95d422cec05b tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5b97afd9-1d49-4b28-a1cb-95d422cec05b tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5b97afd9-1d49-4b28-a1cb-95d422cec05b tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5b97afd9-1d49-4b28-a1cb-95d422cec05b tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5b97afd9-1d49-4b28-a1cb-95d422cec05b tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:42 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:42 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:42 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9 Jul 22 12:25:42 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1369190a-8c0d-4390-95cf-51e890a7dd97 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "cinder-b3e96042-188d-430c-8b02-9f622678c99b-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1369190a-8c0d-4390-95cf-51e890a7dd97 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-b3e96042-188d-430c-8b02-9f622678c99b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:42 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1369190a-8c0d-4390-95cf-51e890a7dd97 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "cinder-quobyte-b3e96042-188d-430c-8b02-9f622678c99b" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1369190a-8c0d-4390-95cf-51e890a7dd97 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-quobyte-b3e96042-188d-430c-8b02-9f622678c99b" acquired by "delete_volume" :: waited 0.033s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:43 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[460f3207-3896-4799-9859-032bc9bc078c]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1369190a-8c0d-4390-95cf-51e890a7dd97 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b3e96042-188d-430c-8b02-9f622678c99b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5b97afd9-1d49-4b28-a1cb-95d422cec05b tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.416s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-5b97afd9-1d49-4b28-a1cb-95d422cec05b tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:43 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-5b97afd9-1d49-4b28-a1cb-95d422cec05b tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Deleted volume successfully. Jul 22 12:25:43 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9" returned: 0 in 0.413s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-356fc2c8-5977-43cb-82b7-08333fff467e tempest-VolumeDependencyTests-1587930118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-356fc2c8-5977-43cb-82b7-08333fff467e tempest-VolumeDependencyTests-1587930118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8427a6-4d8e-44a5-b3c7-73f0736448dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99533a40-238f-438a-ac84-80d8a6d39db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-5b97afd9-1d49-4b28-a1cb-95d422cec05b tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-aa689a47-66a8-425c-8825-4421e95cbd12-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-356fc2c8-5977-43cb-82b7-08333fff467e tempest-VolumeDependencyTests-1587930118 None] Creating offline snapshot b4a0b9f6-1004-41dc-8cd1-27b052fb2c98 of volume a925706e-658d-4e3e-9f05-9a3096f15747 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:25:43 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Volume volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9 (61eb478d-3884-4537-b0e8-2bf0ada1ccf9): created successfully Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99533a40-238f-438a-ac84-80d8a6d39db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Flow 'volume_create_manager' (f9e26cc1-895d-499e-837a-ab23ab5d44e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc05d6f-0ba2-4ff4-9ec3-23881e309ac2]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-356fc2c8-5977-43cb-82b7-08333fff467e tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:43 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b3e96042-188d-430c-8b02-9f622678c99b Jul 22 12:25:43 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:43 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-9871e35c-4f4f-4ae4-a00d-418bc3ef40f6 tempest-ProjectMemberTests-872887571 None] Created volume successfully. Jul 22 12:25:43 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747 Jul 22 12:25:43 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:43 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1369190a-8c0d-4390-95cf-51e890a7dd97 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b3e96042-188d-430c-8b02-9f622678c99b" returned: 0 in 0.416s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1369190a-8c0d-4390-95cf-51e890a7dd97 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b3e96042-188d-430c-8b02-9f622678c99b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:43 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b3e96042-188d-430c-8b02-9f622678c99b Jul 22 12:25:43 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:43 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-356fc2c8-5977-43cb-82b7-08333fff467e tempest-VolumeDependencyTests-1587930118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747" returned: 0 in 0.419s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-356fc2c8-5977-43cb-82b7-08333fff467e tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:43 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98 1G Jul 22 12:25:43 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:43 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1369190a-8c0d-4390-95cf-51e890a7dd97 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b3e96042-188d-430c-8b02-9f622678c99b" returned: 0 in 0.275s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1369190a-8c0d-4390-95cf-51e890a7dd97 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-quobyte-b3e96042-188d-430c-8b02-9f622678c99b" released by "delete_volume" :: held 0.783s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-1369190a-8c0d-4390-95cf-51e890a7dd97 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Created reservations ['af51b595-5905-4ef1-b21c-2f71609b0dbd', 'd805baf5-f6b0-4190-b73f-fa9236cf8f72', '8588b4b8-b8ee-4f46-9bcc-0b2f40b7769e', '7dcac478-4bf1-4732-8496-f3ed0a608653'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1369190a-8c0d-4390-95cf-51e890a7dd97 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1369190a-8c0d-4390-95cf-51e890a7dd97 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1369190a-8c0d-4390-95cf-51e890a7dd97 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1369190a-8c0d-4390-95cf-51e890a7dd97 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1369190a-8c0d-4390-95cf-51e890a7dd97 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1369190a-8c0d-4390-95cf-51e890a7dd97 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:43 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:43 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:44 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-356fc2c8-5977-43cb-82b7-08333fff467e tempest-VolumeDependencyTests-1587930118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98 1G" returned: 0 in 0.584s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-356fc2c8-5977-43cb-82b7-08333fff467e tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a925706e-658d-4e3e-9f05-9a3096f15747 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:44 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a925706e-658d-4e3e-9f05-9a3096f15747 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98 Jul 22 12:25:44 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:44 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2a5ae390-3de7-4cec-ad8f-a54571a269f7 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "cinder-41c04d53-fe79-4337-aa69-5e4dc110e9c3-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:44 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1369190a-8c0d-4390-95cf-51e890a7dd97 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.485s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:44 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-1369190a-8c0d-4390-95cf-51e890a7dd97 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:44 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-1369190a-8c0d-4390-95cf-51e890a7dd97 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Deleted volume successfully. Jul 22 12:25:44 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2a5ae390-3de7-4cec-ad8f-a54571a269f7 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-41c04d53-fe79-4337-aa69-5e4dc110e9c3-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:44 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1369190a-8c0d-4390-95cf-51e890a7dd97 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-b3e96042-188d-430c-8b02-9f622678c99b-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-17d48e76-95ee-4ed9-87f7-03d7e52eeeaf tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:44 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2a5ae390-3de7-4cec-ad8f-a54571a269f7 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "cinder-quobyte-41c04d53-fe79-4337-aa69-5e4dc110e9c3" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:44 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2a5ae390-3de7-4cec-ad8f-a54571a269f7 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-quobyte-41c04d53-fe79-4337-aa69-5e4dc110e9c3" acquired by "delete_volume" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:44 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8d7808-337f-45d1-b9fc-399a3791fb27]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2a5ae390-3de7-4cec-ad8f-a54571a269f7 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-41c04d53-fe79-4337-aa69-5e4dc110e9c3 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:44 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-41c04d53-fe79-4337-aa69-5e4dc110e9c3 Jul 22 12:25:44 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:44 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-356fc2c8-5977-43cb-82b7-08333fff467e tempest-VolumeDependencyTests-1587930118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a925706e-658d-4e3e-9f05-9a3096f15747 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98" returned: 0 in 0.499s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:44 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-356fc2c8-5977-43cb-82b7-08333fff467e tempest-VolumeDependencyTests-1587930118 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98 is being set with open permissions: ugo+rw Jul 22 12:25:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-356fc2c8-5977-43cb-82b7-08333fff467e tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:44 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98 Jul 22 12:25:44 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:44 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2a5ae390-3de7-4cec-ad8f-a54571a269f7 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-41c04d53-fe79-4337-aa69-5e4dc110e9c3" returned: 0 in 0.402s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2a5ae390-3de7-4cec-ad8f-a54571a269f7 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-41c04d53-fe79-4337-aa69-5e4dc110e9c3 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:44 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-356fc2c8-5977-43cb-82b7-08333fff467e tempest-VolumeDependencyTests-1587930118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98" returned: 0 in 0.272s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:45 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-41c04d53-fe79-4337-aa69-5e4dc110e9c3 Jul 22 12:25:45 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-356fc2c8-5977-43cb-82b7-08333fff467e tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:45 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.info Jul 22 12:25:45 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:45 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2a5ae390-3de7-4cec-ad8f-a54571a269f7 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-41c04d53-fe79-4337-aa69-5e4dc110e9c3" returned: 0 in 0.265s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2a5ae390-3de7-4cec-ad8f-a54571a269f7 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-quobyte-41c04d53-fe79-4337-aa69-5e4dc110e9c3" released by "delete_volume" :: held 0.713s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:45 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-2a5ae390-3de7-4cec-ad8f-a54571a269f7 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Created reservations ['cebb12d7-6f07-497c-97a8-428418501447', '7c5528b3-c53e-40b3-a654-e8480ea2f219', '559fa064-fded-4bdd-8dc5-23143d56684c', '5fcf1ad5-fb11-443c-95ad-b5b1620c3f90'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-356fc2c8-5977-43cb-82b7-08333fff467e tempest-VolumeDependencyTests-1587930118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.info" returned: 0 in 0.294s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:45 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-356fc2c8-5977-43cb-82b7-08333fff467e tempest-VolumeDependencyTests-1587930118 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.info is being set with open permissions: ugo+rw Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-356fc2c8-5977-43cb-82b7-08333fff467e tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:45 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.info Jul 22 12:25:45 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2a5ae390-3de7-4cec-ad8f-a54571a269f7 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2a5ae390-3de7-4cec-ad8f-a54571a269f7 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2a5ae390-3de7-4cec-ad8f-a54571a269f7 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2a5ae390-3de7-4cec-ad8f-a54571a269f7 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2a5ae390-3de7-4cec-ad8f-a54571a269f7 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2a5ae390-3de7-4cec-ad8f-a54571a269f7 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:45 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:45 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b7d10ab3-322c-4bb3-9903-8a064ae25835 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "cinder-91f642ec-fea8-4954-9e6b-6ffd4d022dd7-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:45 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-356fc2c8-5977-43cb-82b7-08333fff467e tempest-VolumeDependencyTests-1587930118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.info" returned: 0 in 0.357s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-356fc2c8-5977-43cb-82b7-08333fff467e tempest-VolumeDependencyTests-1587930118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.575s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b7d10ab3-322c-4bb3-9903-8a064ae25835 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-91f642ec-fea8-4954-9e6b-6ffd4d022dd7-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-17d48e76-95ee-4ed9-87f7-03d7e52eeeaf tempest-ProjectMemberTests-872887571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.241s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:45 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-17d48e76-95ee-4ed9-87f7-03d7e52eeeaf tempest-ProjectMemberTests-872887571 None] Creating offline snapshot 9dd33de1-7f2d-45e5-9c77-36661040d4d4 of volume 61eb478d-3884-4537-b0e8-2bf0ada1ccf9 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2a5ae390-3de7-4cec-ad8f-a54571a269f7 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.347s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-2a5ae390-3de7-4cec-ad8f-a54571a269f7 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:45 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-356fc2c8-5977-43cb-82b7-08333fff467e tempest-VolumeDependencyTests-1587930118 None] Create snapshot completed successfully Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[7615cf7e-c999-40e6-b99d-1e147e9d0b9c]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-17d48e76-95ee-4ed9-87f7-03d7e52eeeaf tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:45 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-2a5ae390-3de7-4cec-ad8f-a54571a269f7 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Deleted volume successfully. Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b7d10ab3-322c-4bb3-9903-8a064ae25835 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "cinder-quobyte-91f642ec-fea8-4954-9e6b-6ffd4d022dd7" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2a5ae390-3de7-4cec-ad8f-a54571a269f7 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-41c04d53-fe79-4337-aa69-5e4dc110e9c3-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b7d10ab3-322c-4bb3-9903-8a064ae25835 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-quobyte-91f642ec-fea8-4954-9e6b-6ffd4d022dd7" acquired by "delete_volume" :: waited 0.022s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[119e5352-645b-40ff-97bd-c25799c8ec13]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b7d10ab3-322c-4bb3-9903-8a064ae25835 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-91f642ec-fea8-4954-9e6b-6ffd4d022dd7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:45 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9 Jul 22 12:25:45 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:46 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-91f642ec-fea8-4954-9e6b-6ffd4d022dd7 Jul 22 12:25:46 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:46 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-17d48e76-95ee-4ed9-87f7-03d7e52eeeaf tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9" returned: 0 in 0.427s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-17d48e76-95ee-4ed9-87f7-03d7e52eeeaf tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.9dd33de1-7f2d-45e5-9c77-36661040d4d4 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:46 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.9dd33de1-7f2d-45e5-9c77-36661040d4d4 1G Jul 22 12:25:46 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:46 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b7d10ab3-322c-4bb3-9903-8a064ae25835 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-91f642ec-fea8-4954-9e6b-6ffd4d022dd7" returned: 0 in 0.426s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b7d10ab3-322c-4bb3-9903-8a064ae25835 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-91f642ec-fea8-4954-9e6b-6ffd4d022dd7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:46 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-91f642ec-fea8-4954-9e6b-6ffd4d022dd7 Jul 22 12:25:46 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:46 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b7d10ab3-322c-4bb3-9903-8a064ae25835 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-91f642ec-fea8-4954-9e6b-6ffd4d022dd7" returned: 0 in 0.306s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:46 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b7d10ab3-322c-4bb3-9903-8a064ae25835 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-quobyte-91f642ec-fea8-4954-9e6b-6ffd4d022dd7" released by "delete_volume" :: held 0.795s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:46 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-b7d10ab3-322c-4bb3-9903-8a064ae25835 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Created reservations ['74ce30dc-3d94-4f11-a964-a3294f93bb32', '52f67c0c-c534-4978-b361-6c6b440808e2', 'a61c1e37-c299-4a04-9827-bbf40c8b8859', '16fdba17-22bb-43d2-b446-676b627bfdc6'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:46 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-17d48e76-95ee-4ed9-87f7-03d7e52eeeaf tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.9dd33de1-7f2d-45e5-9c77-36661040d4d4 1G" returned: 0 in 0.561s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-17d48e76-95ee-4ed9-87f7-03d7e52eeeaf tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.9dd33de1-7f2d-45e5-9c77-36661040d4d4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b7d10ab3-322c-4bb3-9903-8a064ae25835 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b7d10ab3-322c-4bb3-9903-8a064ae25835 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:46 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b7d10ab3-322c-4bb3-9903-8a064ae25835 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:46 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b7d10ab3-322c-4bb3-9903-8a064ae25835 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b7d10ab3-322c-4bb3-9903-8a064ae25835 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:46 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b7d10ab3-322c-4bb3-9903-8a064ae25835 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:46 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.9dd33de1-7f2d-45e5-9c77-36661040d4d4 Jul 22 12:25:46 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:46 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:46 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:46 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d66c067c-9294-4ebc-a478-5273e3d389bc tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "cinder-5be66bd7-2911-4b85-8e29-48b61b221ceb-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:46 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d66c067c-9294-4ebc-a478-5273e3d389bc tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-5be66bd7-2911-4b85-8e29-48b61b221ceb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d66c067c-9294-4ebc-a478-5273e3d389bc tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "cinder-quobyte-5be66bd7-2911-4b85-8e29-48b61b221ceb" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d66c067c-9294-4ebc-a478-5273e3d389bc tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-quobyte-5be66bd7-2911-4b85-8e29-48b61b221ceb" acquired by "delete_volume" :: waited 0.032s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[644941c6-eed9-4a3c-b1e1-633f2912f313]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d66c067c-9294-4ebc-a478-5273e3d389bc tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5be66bd7-2911-4b85-8e29-48b61b221ceb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Flow 'volume_create_manager' (2eb559aa-22b4-40d7-bba0-99edfd6c85bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13cd347f-c5d8-4059-9519-e3af3735696a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:47 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13cd347f-c5d8-4059-9519-e3af3735696a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2091541393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe06d74-21a2-4b8f-b095-d2f9b2143ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a72f95b1ab4678a7ea3f9ca98b84a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b4a0b9f6-1004-41dc-8cd1-27b052fb2c98,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:47Z,use_quota=True,user_id='e7c12e9bfe144ee5ad31754dbe515910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:47 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5be66bd7-2911-4b85-8e29-48b61b221ceb Jul 22 12:25:47 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561fcaed-e327-4104-a5e4-d18c4dbca238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561fcaed-e327-4104-a5e4-d18c4dbca238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:47 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31d5e01-fe0a-4b4e-a3c5-7f5a8d15a3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31d5e01-fe0a-4b4e-a3c5-7f5a8d15a3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'afe06d74-21a2-4b8f-b095-d2f9b2143ced', 'volume_name': 'volume-afe06d74-21a2-4b8f-b095-d2f9b2143ced', 'volume_size': 1, 'snapshot_id': 'b4a0b9f6-1004-41dc-8cd1-27b052fb2c98'}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7292066-c75b-473e-8968-3ac926032d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7292066-c75b-473e-8968-3ac926032d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73eef583-e03b-452b-a75b-18f20ed9b1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:47 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Volume afe06d74-21a2-4b8f-b095-d2f9b2143ced: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-afe06d74-21a2-4b8f-b095-d2f9b2143ced', 'volume_size': 1, 'snapshot_id': 'b4a0b9f6-1004-41dc-8cd1-27b052fb2c98'} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b7d10ab3-322c-4bb3-9903-8a064ae25835 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.463s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-17d48e76-95ee-4ed9-87f7-03d7e52eeeaf tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.9dd33de1-7f2d-45e5-9c77-36661040d4d4" returned: 0 in 0.512s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-b7d10ab3-322c-4bb3-9903-8a064ae25835 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:47 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-17d48e76-95ee-4ed9-87f7-03d7e52eeeaf tempest-ProjectMemberTests-872887571 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.9dd33de1-7f2d-45e5-9c77-36661040d4d4 is being set with open permissions: ugo+rw Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-17d48e76-95ee-4ed9-87f7-03d7e52eeeaf tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.9dd33de1-7f2d-45e5-9c77-36661040d4d4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:47 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b7d10ab3-322c-4bb3-9903-8a064ae25835 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Deleted volume successfully. Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:47 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.9dd33de1-7f2d-45e5-9c77-36661040d4d4 Jul 22 12:25:47 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b7d10ab3-322c-4bb3-9903-8a064ae25835 tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-91f642ec-fea8-4954-9e6b-6ffd4d022dd7-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:47 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d66c067c-9294-4ebc-a478-5273e3d389bc tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5be66bd7-2911-4b85-8e29-48b61b221ceb" returned: 0 in 0.445s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d66c067c-9294-4ebc-a478-5273e3d389bc tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5be66bd7-2911-4b85-8e29-48b61b221ceb {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:47 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5be66bd7-2911-4b85-8e29-48b61b221ceb Jul 22 12:25:47 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:47 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-17d48e76-95ee-4ed9-87f7-03d7e52eeeaf tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.9dd33de1-7f2d-45e5-9c77-36661040d4d4" returned: 0 in 0.278s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-17d48e76-95ee-4ed9-87f7-03d7e52eeeaf tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:47 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.info Jul 22 12:25:47 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:47 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d66c067c-9294-4ebc-a478-5273e3d389bc tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-5be66bd7-2911-4b85-8e29-48b61b221ceb" returned: 0 in 0.274s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d66c067c-9294-4ebc-a478-5273e3d389bc tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-quobyte-5be66bd7-2911-4b85-8e29-48b61b221ceb" released by "delete_volume" :: held 0.804s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:47 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-17d48e76-95ee-4ed9-87f7-03d7e52eeeaf tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.info" returned: 0 in 0.280s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:47 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-17d48e76-95ee-4ed9-87f7-03d7e52eeeaf tempest-ProjectMemberTests-872887571 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.info is being set with open permissions: ugo+rw Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-17d48e76-95ee-4ed9-87f7-03d7e52eeeaf tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-d66c067c-9294-4ebc-a478-5273e3d389bc tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Created reservations ['c7e356d4-dcfc-47be-8679-689779b0e194', '82772982-ad04-42dd-ba86-5f902c980d71', '55496339-6c33-4573-b3dc-ee2560e1329e', '741855dc-7dcd-40d9-b49d-7dada4220ee8'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:47 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.info Jul 22 12:25:47 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d66c067c-9294-4ebc-a478-5273e3d389bc tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d66c067c-9294-4ebc-a478-5273e3d389bc tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d66c067c-9294-4ebc-a478-5273e3d389bc tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d66c067c-9294-4ebc-a478-5273e3d389bc tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d66c067c-9294-4ebc-a478-5273e3d389bc tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:47 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d66c067c-9294-4ebc-a478-5273e3d389bc tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:48 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:48 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b7de501b-8218-4459-8404-fc046002825c tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "cinder-ad0269bf-7557-49d8-998a-7d4497a051c5-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b7de501b-8218-4459-8404-fc046002825c tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-ad0269bf-7557-49d8-998a-7d4497a051c5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:48 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-17d48e76-95ee-4ed9-87f7-03d7e52eeeaf tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.info" returned: 0 in 0.302s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-17d48e76-95ee-4ed9-87f7-03d7e52eeeaf tempest-ProjectMemberTests-872887571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.481s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.902s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Acquiring lock "cinder-quobyte-b4a0b9f6-1004-41dc-8cd1-27b052fb2c98-afe06d74-21a2-4b8f-b095-d2f9b2143ced" by "_create_volume_from_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b7de501b-8218-4459-8404-fc046002825c tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "cinder-quobyte-ad0269bf-7557-49d8-998a-7d4497a051c5" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Lock "cinder-quobyte-b4a0b9f6-1004-41dc-8cd1-27b052fb2c98-afe06d74-21a2-4b8f-b095-d2f9b2143ced" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Creating volume afe06d74-21a2-4b8f-b095-d2f9b2143ced from snapshot b4a0b9f6-1004-41dc-8cd1-27b052fb2c98 {{(pid=87568) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Acquiring lock "cinder-quobyte-afe06d74-21a2-4b8f-b095-d2f9b2143ced" by "_copy_volume_from_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:48 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-17d48e76-95ee-4ed9-87f7-03d7e52eeeaf tempest-ProjectMemberTests-872887571 None] Create snapshot completed successfully Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b7de501b-8218-4459-8404-fc046002825c tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-quobyte-ad0269bf-7557-49d8-998a-7d4497a051c5" acquired by "delete_volume" :: waited 0.036s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:48 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d66c067c-9294-4ebc-a478-5273e3d389bc tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.326s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-d66c067c-9294-4ebc-a478-5273e3d389bc tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Lock "cinder-quobyte-afe06d74-21a2-4b8f-b095-d2f9b2143ced" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] snapshot: b4a0b9f6-1004-41dc-8cd1-27b052fb2c98, volume: afe06d74-21a2-4b8f-b095-d2f9b2143ced, {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 12:25:48 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d66c067c-9294-4ebc-a478-5273e3d389bc tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Deleted volume successfully. Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5813d246-865d-42da-9a98-37a0d39e80fa]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b7de501b-8218-4459-8404-fc046002825c tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ad0269bf-7557-49d8-998a-7d4497a051c5 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[03aedf89-f55c-4b9b-8b48-1bb9ce17267e]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d66c067c-9294-4ebc-a478-5273e3d389bc tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-5be66bd7-2911-4b85-8e29-48b61b221ceb-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:48 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ad0269bf-7557-49d8-998a-7d4497a051c5 Jul 22 12:25:48 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:48 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98 Jul 22 12:25:48 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d0353bc3-500f-4d4c-b60c-e5098656fa88 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-9dd33de1-7f2d-45e5-9c77-36661040d4d4-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d0353bc3-500f-4d4c-b60c-e5098656fa88 tempest-ProjectMemberTests-872887571 None] Lock "cinder-9dd33de1-7f2d-45e5-9c77-36661040d4d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d0353bc3-500f-4d4c-b60c-e5098656fa88 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-61eb478d-3884-4537-b0e8-2bf0ada1ccf9" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d0353bc3-500f-4d4c-b60c-e5098656fa88 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-61eb478d-3884-4537-b0e8-2bf0ada1ccf9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d0353bc3-500f-4d4c-b60c-e5098656fa88 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-9dd33de1-7f2d-45e5-9c77-36661040d4d4" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d0353bc3-500f-4d4c-b60c-e5098656fa88 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-9dd33de1-7f2d-45e5-9c77-36661040d4d4" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-d0353bc3-500f-4d4c-b60c-e5098656fa88 tempest-ProjectMemberTests-872887571 None] Deleting offline snapshot 9dd33de1-7f2d-45e5-9c77-36661040d4d4 of volume 61eb478d-3884-4537-b0e8-2bf0ada1ccf9 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-d0353bc3-500f-4d4c-b60c-e5098656fa88 tempest-ProjectMemberTests-872887571 None] snapshot_file for this snap is: volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.9dd33de1-7f2d-45e5-9c77-36661040d4d4 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ef2029-4753-4b77-8b14-217c9514f876]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d0353bc3-500f-4d4c-b60c-e5098656fa88 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.9dd33de1-7f2d-45e5-9c77-36661040d4d4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:48 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b7de501b-8218-4459-8404-fc046002825c tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ad0269bf-7557-49d8-998a-7d4497a051c5" returned: 0 in 0.477s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b7de501b-8218-4459-8404-fc046002825c tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ad0269bf-7557-49d8-998a-7d4497a051c5 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:48 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ad0269bf-7557-49d8-998a-7d4497a051c5 Jul 22 12:25:48 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:48 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98" returned: 0 in 0.499s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a925706e-658d-4e3e-9f05-9a3096f15747(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] will copy from snapshot at /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747 {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Creating direct copy from snapshot {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[0561f0a4-3cc8-4540-8c63-18465dc9717d]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:48 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:48 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.9dd33de1-7f2d-45e5-9c77-36661040d4d4 Jul 22 12:25:48 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:49 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747 Jul 22 12:25:49 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Flow 'volume_create_manager' (e622ce7a-1d85-42ba-aa61-4f4078dfe80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bae4539-73ea-41b1-ba1c-9b7df5edc669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:49 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bae4539-73ea-41b1-ba1c-9b7df5edc669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1168099565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3219689-b330-461d-a898-a833ad90aa41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f63399c06fe47509996d028e2e02634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:49Z,use_quota=True,user_id='bbe9dbd345eb4efc802016ed89e01d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cd9ae8-a8be-40ec-9930-ee5b3f9d1b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cd9ae8-a8be-40ec-9930-ee5b3f9d1b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf9441e-b4e1-46dc-b93a-187c900a50ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf9441e-b4e1-46dc-b93a-187c900a50ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3219689-b330-461d-a898-a833ad90aa41', 'volume_name': 'volume-e3219689-b330-461d-a898-a833ad90aa41', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a54b2d-752c-4a1f-8a2b-bc3be32b19ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a54b2d-752c-4a1f-8a2b-bc3be32b19ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397175d7-7734-4a9f-bee7-02235035418a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:49 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Volume e3219689-b330-461d-a898-a833ad90aa41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3219689-b330-461d-a898-a833ad90aa41', 'volume_size': 1} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b7de501b-8218-4459-8404-fc046002825c tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ad0269bf-7557-49d8-998a-7d4497a051c5" returned: 0 in 0.339s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b7de501b-8218-4459-8404-fc046002825c tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-quobyte-ad0269bf-7557-49d8-998a-7d4497a051c5" released by "delete_volume" :: held 0.877s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-b7de501b-8218-4459-8404-fc046002825c tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Created reservations ['7b8fbc5e-bf1e-4486-a2e6-d1834d788c1d', 'ddd67789-1882-440b-91b5-e3254461e175', 'c63e6cc8-810c-4bad-a918-ebaebca730f0', 'b49923c9-38f3-4c2c-9b17-9454d1209d29'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:49 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d0353bc3-500f-4d4c-b60c-e5098656fa88 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.9dd33de1-7f2d-45e5-9c77-36661040d4d4" returned: 0 in 0.467s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-d0353bc3-500f-4d4c-b60c-e5098656fa88 tempest-ProjectMemberTests-872887571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f35b8d-40e3-46d7-a31a-667b6f1bcc7d]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d0353bc3-500f-4d4c-b60c-e5098656fa88 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b7de501b-8218-4459-8404-fc046002825c tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b7de501b-8218-4459-8404-fc046002825c tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b7de501b-8218-4459-8404-fc046002825c tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-b7de501b-8218-4459-8404-fc046002825c tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-b7de501b-8218-4459-8404-fc046002825c tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b7de501b-8218-4459-8404-fc046002825c tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:49 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747" returned: 0 in 0.475s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG cinder.utils [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Path /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-afe06d74-21a2-4b8f-b095-d2f9b2143ced not found in is_blk_device check {{(pid=87568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-afe06d74-21a2-4b8f-b095-d2f9b2143ced {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:49 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:49 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:49 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9 Jul 22 12:25:49 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:49 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-afe06d74-21a2-4b8f-b095-d2f9b2143ced Jul 22 12:25:49 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:49 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b7de501b-8218-4459-8404-fc046002825c tempest-CreateVolumesFromSourceVolumeTest-995509756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.246s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-b7de501b-8218-4459-8404-fc046002825c tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:49 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b7de501b-8218-4459-8404-fc046002825c tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Deleted volume successfully. Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b7de501b-8218-4459-8404-fc046002825c tempest-CreateVolumesFromSourceVolumeTest-995509756 None] Lock "cinder-ad0269bf-7557-49d8-998a-7d4497a051c5-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:49 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d0353bc3-500f-4d4c-b60c-e5098656fa88 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9" returned: 0 in 0.389s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:49 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d0353bc3-500f-4d4c-b60c-e5098656fa88 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.9dd33de1-7f2d-45e5-9c77-36661040d4d4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:49 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.9dd33de1-7f2d-45e5-9c77-36661040d4d4 Jul 22 12:25:49 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:50 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d0353bc3-500f-4d4c-b60c-e5098656fa88 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.9dd33de1-7f2d-45e5-9c77-36661040d4d4" returned: 0 in 0.563s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d0353bc3-500f-4d4c-b60c-e5098656fa88 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.9dd33de1-7f2d-45e5-9c77-36661040d4d4 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:50 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.9dd33de1-7f2d-45e5-9c77-36661040d4d4 Jul 22 12:25:50 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:50 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:50 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d0353bc3-500f-4d4c-b60c-e5098656fa88 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9.9dd33de1-7f2d-45e5-9c77-36661040d4d4" returned: 0 in 0.576s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:50 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d0353bc3-500f-4d4c-b60c-e5098656fa88 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-9dd33de1-7f2d-45e5-9c77-36661040d4d4" released by "_delete_snapshot" :: held 2.175s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:50 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d0353bc3-500f-4d4c-b60c-e5098656fa88 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-61eb478d-3884-4537-b0e8-2bf0ada1ccf9" released by "delete_snapshot" :: held 2.232s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:51 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-d0353bc3-500f-4d4c-b60c-e5098656fa88 tempest-ProjectMemberTests-872887571 None] Created reservations ['0c332a0a-cb78-4468-b737-1b4fa4bd48a8', 'b8b71043-617e-47aa-a3a3-566df40a9377', '0c14baa9-84d9-47ae-bf3d-9c0ea5b3ea7c', '74798b8d-4e8d-4abc-8340-82f66a082455'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:51 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d0353bc3-500f-4d4c-b60c-e5098656fa88 tempest-ProjectMemberTests-872887571 None] Delete snapshot completed successfully. Jul 22 12:25:51 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d0353bc3-500f-4d4c-b60c-e5098656fa88 tempest-ProjectMemberTests-872887571 None] Lock "cinder-9dd33de1-7f2d-45e5-9c77-36661040d4d4-delete_snapshot" released by "delete_snapshot" :: held 2.698s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:52 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-414e0051-f12a-4683-906c-5e45a89d488d tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-61eb478d-3884-4537-b0e8-2bf0ada1ccf9-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:52 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-414e0051-f12a-4683-906c-5e45a89d488d tempest-ProjectMemberTests-872887571 None] Lock "cinder-61eb478d-3884-4537-b0e8-2bf0ada1ccf9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:52 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-414e0051-f12a-4683-906c-5e45a89d488d tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-61eb478d-3884-4537-b0e8-2bf0ada1ccf9" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:52 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-414e0051-f12a-4683-906c-5e45a89d488d tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-61eb478d-3884-4537-b0e8-2bf0ada1ccf9" acquired by "delete_volume" :: waited 0.057s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:52 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e2d59e-b4ba-4a19-951b-84c00f406849]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:52 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-414e0051-f12a-4683-906c-5e45a89d488d tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:52 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9 Jul 22 12:25:52 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:53 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-414e0051-f12a-4683-906c-5e45a89d488d tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9" returned: 0 in 1.027s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-414e0051-f12a-4683-906c-5e45a89d488d tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:53 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9 Jul 22 12:25:53 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:53 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:53 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-414e0051-f12a-4683-906c-5e45a89d488d tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-61eb478d-3884-4537-b0e8-2bf0ada1ccf9" returned: 0 in 0.514s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:54 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-414e0051-f12a-4683-906c-5e45a89d488d tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-61eb478d-3884-4537-b0e8-2bf0ada1ccf9" released by "delete_volume" :: held 1.733s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:54 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-414e0051-f12a-4683-906c-5e45a89d488d tempest-ProjectMemberTests-872887571 None] Created reservations ['e1381a5f-b42e-4de7-ab14-03f545382ae6', '59798fc2-71d8-4606-b7e0-c437926cc1d8', 'ded3b28a-07f9-42fa-a47b-bc3a4545e4ee', 'd1271099-03d7-4e6e-965d-74f045480166'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-414e0051-f12a-4683-906c-5e45a89d488d tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-414e0051-f12a-4683-906c-5e45a89d488d tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:54 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-414e0051-f12a-4683-906c-5e45a89d488d tempest-ProjectMemberTests-872887571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:54 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-414e0051-f12a-4683-906c-5e45a89d488d tempest-ProjectMemberTests-872887571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-414e0051-f12a-4683-906c-5e45a89d488d tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-414e0051-f12a-4683-906c-5e45a89d488d tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:54 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:25:54 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:54 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-afe06d74-21a2-4b8f-b095-d2f9b2143ced" returned: 0 in 5.529s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:54 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11e474d-4919-428c-8f3d-c7f87b0eadc1]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:54 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:54 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-414e0051-f12a-4683-906c-5e45a89d488d tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.582s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:54 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-414e0051-f12a-4683-906c-5e45a89d488d tempest-ProjectMemberTests-872887571 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:25:55 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-414e0051-f12a-4683-906c-5e45a89d488d tempest-ProjectMemberTests-872887571 None] Deleted volume successfully. Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-414e0051-f12a-4683-906c-5e45a89d488d tempest-ProjectMemberTests-872887571 None] Lock "cinder-61eb478d-3884-4537-b0e8-2bf0ada1ccf9-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:55 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747 Jul 22 12:25:55 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Flow 'volume_create_manager' (b2364fb0-3d82-4fbb-9084-663e89936f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce5b720-f99c-4a6e-aadf-e7ab4831ee19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce5b720-f99c-4a6e-aadf-e7ab4831ee19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-253057062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b14d729d-833d-4301-bc9d-48f74dbfe05b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89707e5757184c76b39c42c3553f59c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:55Z,use_quota=True,user_id='edd7857f9fd44201b44894c8b9b98d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91e3398-d436-46ef-89d8-7c2fbcbc96b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91e3398-d436-46ef-89d8-7c2fbcbc96b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03a1464-307d-4160-af23-0ac1365f51d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03a1464-307d-4160-af23-0ac1365f51d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b14d729d-833d-4301-bc9d-48f74dbfe05b', 'volume_name': 'volume-b14d729d-833d-4301-bc9d-48f74dbfe05b', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146d3308-8712-4483-a066-c5230aacac40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146d3308-8712-4483-a066-c5230aacac40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d292eab-6209-48ca-b0ae-a0a83735a3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:55 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Volume b14d729d-833d-4301-bc9d-48f74dbfe05b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b14d729d-833d-4301-bc9d-48f74dbfe05b', 'volume_size': 1} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:55 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747" returned: 0 in 0.627s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Image conversion details: src /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-afe06d74-21a2-4b8f-b095-d2f9b2143ced {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:25:55 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Converted 1024.00 MB image at 185.11 MB/s Jul 22 12:25:55 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-afe06d74-21a2-4b8f-b095-d2f9b2143ced is being set with open permissions: ugo+rw Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-afe06d74-21a2-4b8f-b095-d2f9b2143ced {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:55 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-afe06d74-21a2-4b8f-b095-d2f9b2143ced Jul 22 12:25:55 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:55 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-afe06d74-21a2-4b8f-b095-d2f9b2143ced" returned: 0 in 0.258s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Lock "cinder-quobyte-afe06d74-21a2-4b8f-b095-d2f9b2143ced" released by "_copy_volume_from_snapshot" :: held 7.515s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Lock "cinder-quobyte-b4a0b9f6-1004-41dc-8cd1-27b052fb2c98-afe06d74-21a2-4b8f-b095-d2f9b2143ced" released by "_create_volume_from_snapshot" :: held 7.584s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.623s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.704s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1168099565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3219689-b330-461d-a898-a833ad90aa41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f63399c06fe47509996d028e2e02634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:49Z,use_quota=True,user_id='bbe9dbd345eb4efc802016ed89e01d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Creating volume e3219689-b330-461d-a898-a833ad90aa41 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:55 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:55 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41 1073741824 Jul 22 12:25:55 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73eef583-e03b-452b-a75b-18f20ed9b1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afe06d74-21a2-4b8f-b095-d2f9b2143ced', 'volume_size': 1, 'snapshot_id': 'b4a0b9f6-1004-41dc-8cd1-27b052fb2c98'}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c773fe-f312-4c37-a1b5-82a468aa7fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:55 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Volume volume-afe06d74-21a2-4b8f-b095-d2f9b2143ced (afe06d74-21a2-4b8f-b095-d2f9b2143ced): created successfully Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c773fe-f312-4c37-a1b5-82a468aa7fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:55 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Flow 'volume_create_manager' (2eb559aa-22b4-40d7-bba0-99edfd6c85bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:55 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-203176de-ab53-4027-9788-fd7fa1738e41 tempest-VolumeDependencyTests-1587930118 None] Created volume successfully. Jul 22 12:25:56 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41 1073741824" returned: 0 in 0.494s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:56 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41 Jul 22 12:25:56 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:56 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41" returned: 0 in 0.254s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:56 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.138s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:56 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-253057062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b14d729d-833d-4301-bc9d-48f74dbfe05b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89707e5757184c76b39c42c3553f59c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:25:55Z,use_quota=True,user_id='edd7857f9fd44201b44894c8b9b98d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:25:56 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Creating volume b14d729d-833d-4301-bc9d-48f74dbfe05b {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:25:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:56 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:25:56 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:25:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:56 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:25:56 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:25:56 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:56 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397175d7-7734-4a9f-bee7-02235035418a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3219689-b330-461d-a898-a833ad90aa41', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:56 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b 1073741824 Jul 22 12:25:56 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:56 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56314e5-02a9-49d9-9f73-c5c16e162fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:56 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Volume volume-e3219689-b330-461d-a898-a833ad90aa41 (e3219689-b330-461d-a898-a833ad90aa41): created successfully Jul 22 12:25:56 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56314e5-02a9-49d9-9f73-c5c16e162fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:56 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Flow 'volume_create_manager' (e622ce7a-1d85-42ba-aa61-4f4078dfe80e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:56 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-8295429a-9267-440b-ac65-592615266db6 tempest-ProjectReaderTests-831764688 None] Created volume successfully. Jul 22 12:25:57 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b 1073741824" returned: 0 in 0.530s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b0b2eca2-2dd6-4c63-822e-40c9f3b234b3 tempest-VolumeDependencyTests-1587930118 None] Acquiring lock "cinder-b4a0b9f6-1004-41dc-8cd1-27b052fb2c98-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9486edd3-92a7-4aea-9719-b56e5f6936fc tempest-ProjectReaderTests-831764688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b0b2eca2-2dd6-4c63-822e-40c9f3b234b3 tempest-VolumeDependencyTests-1587930118 None] Lock "cinder-b4a0b9f6-1004-41dc-8cd1-27b052fb2c98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b0b2eca2-2dd6-4c63-822e-40c9f3b234b3 tempest-VolumeDependencyTests-1587930118 None] Acquiring lock "cinder-quobyte-a925706e-658d-4e3e-9f05-9a3096f15747" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b0b2eca2-2dd6-4c63-822e-40c9f3b234b3 tempest-VolumeDependencyTests-1587930118 None] Lock "cinder-quobyte-a925706e-658d-4e3e-9f05-9a3096f15747" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b0b2eca2-2dd6-4c63-822e-40c9f3b234b3 tempest-VolumeDependencyTests-1587930118 None] Acquiring lock "cinder-quobyte-b4a0b9f6-1004-41dc-8cd1-27b052fb2c98" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:57 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b Jul 22 12:25:57 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b0b2eca2-2dd6-4c63-822e-40c9f3b234b3 tempest-VolumeDependencyTests-1587930118 None] Lock "cinder-quobyte-b4a0b9f6-1004-41dc-8cd1-27b052fb2c98" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-b0b2eca2-2dd6-4c63-822e-40c9f3b234b3 tempest-VolumeDependencyTests-1587930118 None] Deleting offline snapshot b4a0b9f6-1004-41dc-8cd1-27b052fb2c98 of volume a925706e-658d-4e3e-9f05-9a3096f15747 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-b0b2eca2-2dd6-4c63-822e-40c9f3b234b3 tempest-VolumeDependencyTests-1587930118 None] snapshot_file for this snap is: volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[609b1b20-dd83-48a7-a610-8ee437805492]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b0b2eca2-2dd6-4c63-822e-40c9f3b234b3 tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:57 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98 Jul 22 12:25:57 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:57 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b" returned: 0 in 0.286s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9486edd3-92a7-4aea-9719-b56e5f6936fc tempest-ProjectReaderTests-831764688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.339s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d292eab-6209-48ca-b0ae-a0a83735a3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b14d729d-833d-4301-bc9d-48f74dbfe05b', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5dee206-b6f3-4bd5-899a-946c5b18b98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-9486edd3-92a7-4aea-9719-b56e5f6936fc tempest-ProjectReaderTests-831764688 None] Creating offline snapshot 2c20d660-5885-4ac3-8c06-80f5ab91364c of volume e3219689-b330-461d-a898-a833ad90aa41 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:25:57 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Volume volume-b14d729d-833d-4301-bc9d-48f74dbfe05b (b14d729d-833d-4301-bc9d-48f74dbfe05b): created successfully Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5dee206-b6f3-4bd5-899a-946c5b18b98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Flow 'volume_create_manager' (b2364fb0-3d82-4fbb-9084-663e89936f6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[af29b2b4-1c15-450b-8de7-159a0089d106]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9486edd3-92a7-4aea-9719-b56e5f6936fc tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:57 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-346509d0-c71b-4945-8b7b-fa0185c25512 tempest-ProjectMemberTests-872887571 None] Created volume successfully. Jul 22 12:25:57 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41 Jul 22 12:25:57 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:57 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b0b2eca2-2dd6-4c63-822e-40c9f3b234b3 tempest-VolumeDependencyTests-1587930118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98" returned: 0 in 0.416s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-b0b2eca2-2dd6-4c63-822e-40c9f3b234b3 tempest-VolumeDependencyTests-1587930118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a925706e-658d-4e3e-9f05-9a3096f15747(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5dc76e-bc25-497d-b827-092efa488f80]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:57 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b0b2eca2-2dd6-4c63-822e-40c9f3b234b3 tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:57 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747 Jul 22 12:25:57 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:58 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9486edd3-92a7-4aea-9719-b56e5f6936fc tempest-ProjectReaderTests-831764688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41" returned: 0 in 0.446s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9486edd3-92a7-4aea-9719-b56e5f6936fc tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.2c20d660-5885-4ac3-8c06-80f5ab91364c 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:58 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.2c20d660-5885-4ac3-8c06-80f5ab91364c 1G Jul 22 12:25:58 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:58 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b0b2eca2-2dd6-4c63-822e-40c9f3b234b3 tempest-VolumeDependencyTests-1587930118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747" returned: 0 in 0.481s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b0b2eca2-2dd6-4c63-822e-40c9f3b234b3 tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:58 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98 Jul 22 12:25:58 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:58 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9486edd3-92a7-4aea-9719-b56e5f6936fc tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.2c20d660-5885-4ac3-8c06-80f5ab91364c 1G" returned: 0 in 0.547s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9486edd3-92a7-4aea-9719-b56e5f6936fc tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3219689-b330-461d-a898-a833ad90aa41 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.2c20d660-5885-4ac3-8c06-80f5ab91364c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:58 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3219689-b330-461d-a898-a833ad90aa41 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.2c20d660-5885-4ac3-8c06-80f5ab91364c Jul 22 12:25:58 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:58 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:UPDATE=344,cinder:SELECT=249,cinder:INSERT=82,cinder:DELETE=28 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:25:58 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=250,cinder:UPDATE=324,cinder:DELETE=33,cinder:INSERT=96 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:25:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1534b7eb-705d-4483-ab7b-dca537514509 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:25:58 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b0b2eca2-2dd6-4c63-822e-40c9f3b234b3 tempest-VolumeDependencyTests-1587930118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98" returned: 0 in 0.480s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b0b2eca2-2dd6-4c63-822e-40c9f3b234b3 tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:58 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98 Jul 22 12:25:58 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:59 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9486edd3-92a7-4aea-9719-b56e5f6936fc tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3219689-b330-461d-a898-a833ad90aa41 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.2c20d660-5885-4ac3-8c06-80f5ab91364c" returned: 0 in 0.440s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:59 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-9486edd3-92a7-4aea-9719-b56e5f6936fc tempest-ProjectReaderTests-831764688 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.2c20d660-5885-4ac3-8c06-80f5ab91364c is being set with open permissions: ugo+rw Jul 22 12:25:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9486edd3-92a7-4aea-9719-b56e5f6936fc tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.2c20d660-5885-4ac3-8c06-80f5ab91364c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:59 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.2c20d660-5885-4ac3-8c06-80f5ab91364c Jul 22 12:25:59 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:59 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b0b2eca2-2dd6-4c63-822e-40c9f3b234b3 tempest-VolumeDependencyTests-1587930118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747.b4a0b9f6-1004-41dc-8cd1-27b052fb2c98" returned: 0 in 0.335s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:59 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b0b2eca2-2dd6-4c63-822e-40c9f3b234b3 tempest-VolumeDependencyTests-1587930118 None] Lock "cinder-quobyte-b4a0b9f6-1004-41dc-8cd1-27b052fb2c98" released by "_delete_snapshot" :: held 1.871s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:59 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b0b2eca2-2dd6-4c63-822e-40c9f3b234b3 tempest-VolumeDependencyTests-1587930118 None] Lock "cinder-quobyte-a925706e-658d-4e3e-9f05-9a3096f15747" released by "delete_snapshot" :: held 1.912s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:59 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-b0b2eca2-2dd6-4c63-822e-40c9f3b234b3 tempest-VolumeDependencyTests-1587930118 None] Created reservations ['4b8492e4-52c2-48f8-afad-176bd6726079', '6e111c3c-04ff-4371-a3cd-30f7bfcdeff0', 'd915a57e-8a2f-40e0-94bd-c71c8c4d49bf', 'a4563ea5-c046-4fe1-a374-ec20c552de71'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:25:59 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b0b2eca2-2dd6-4c63-822e-40c9f3b234b3 tempest-VolumeDependencyTests-1587930118 None] Delete snapshot completed successfully. Jul 22 12:25:59 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b0b2eca2-2dd6-4c63-822e-40c9f3b234b3 tempest-VolumeDependencyTests-1587930118 None] Lock "cinder-b4a0b9f6-1004-41dc-8cd1-27b052fb2c98-delete_snapshot" released by "delete_snapshot" :: held 2.088s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:25:59 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9486edd3-92a7-4aea-9719-b56e5f6936fc tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.2c20d660-5885-4ac3-8c06-80f5ab91364c" returned: 0 in 0.294s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9486edd3-92a7-4aea-9719-b56e5f6936fc tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:59 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.info Jul 22 12:25:59 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:59 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-004b50c1-55eb-488f-bf31-ea7bae6fe80e tempest-VolumeDependencyTests-1587930118 None] Acquiring lock "cinder-a925706e-658d-4e3e-9f05-9a3096f15747-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:59 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-004b50c1-55eb-488f-bf31-ea7bae6fe80e tempest-VolumeDependencyTests-1587930118 None] Lock "cinder-a925706e-658d-4e3e-9f05-9a3096f15747-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:59 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-004b50c1-55eb-488f-bf31-ea7bae6fe80e tempest-VolumeDependencyTests-1587930118 None] Acquiring lock "cinder-quobyte-a925706e-658d-4e3e-9f05-9a3096f15747" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:25:59 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-004b50c1-55eb-488f-bf31-ea7bae6fe80e tempest-VolumeDependencyTests-1587930118 None] Lock "cinder-quobyte-a925706e-658d-4e3e-9f05-9a3096f15747" acquired by "delete_volume" :: waited 0.020s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:25:59 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e71cccd-9988-4ce4-88db-444d9359492f]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:25:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-004b50c1-55eb-488f-bf31-ea7bae6fe80e tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:59 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9486edd3-92a7-4aea-9719-b56e5f6936fc tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.info" returned: 0 in 0.333s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:25:59 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-9486edd3-92a7-4aea-9719-b56e5f6936fc tempest-ProjectReaderTests-831764688 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.info is being set with open permissions: ugo+rw Jul 22 12:25:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9486edd3-92a7-4aea-9719-b56e5f6936fc tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:25:59 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.info Jul 22 12:25:59 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:59 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747 Jul 22 12:25:59 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:25:59 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Jul 22 12:25:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9486edd3-92a7-4aea-9719-b56e5f6936fc tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.info" returned: 0 in 0.253s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9486edd3-92a7-4aea-9719-b56e5f6936fc tempest-ProjectReaderTests-831764688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.439s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1534b7eb-705d-4483-ab7b-dca537514509 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.256s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-1534b7eb-705d-4483-ab7b-dca537514509 tempest-ProjectMemberTests-872887571 None] Creating offline snapshot 2628d905-7b76-42e3-8582-bf48eb6cc5c1 of volume b14d729d-833d-4301-bc9d-48f74dbfe05b {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:26:00 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-9486edd3-92a7-4aea-9719-b56e5f6936fc tempest-ProjectReaderTests-831764688 None] Create snapshot completed successfully Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[208cf8ee-65c7-4709-8650-42ba52e04c1b]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1534b7eb-705d-4483-ab7b-dca537514509 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:00 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-004b50c1-55eb-488f-bf31-ea7bae6fe80e tempest-VolumeDependencyTests-1587930118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747" returned: 0 in 0.433s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-004b50c1-55eb-488f-bf31-ea7bae6fe80e tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:00 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747 Jul 22 12:26:00 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:00 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b Jul 22 12:26:00 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:00 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-004b50c1-55eb-488f-bf31-ea7bae6fe80e tempest-VolumeDependencyTests-1587930118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-a925706e-658d-4e3e-9f05-9a3096f15747" returned: 0 in 0.273s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-004b50c1-55eb-488f-bf31-ea7bae6fe80e tempest-VolumeDependencyTests-1587930118 None] Lock "cinder-quobyte-a925706e-658d-4e3e-9f05-9a3096f15747" released by "delete_volume" :: held 0.794s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-004b50c1-55eb-488f-bf31-ea7bae6fe80e tempest-VolumeDependencyTests-1587930118 None] Created reservations ['e8b37e0c-d8cf-42c9-8946-27004300e7c6', '7597caf1-c3d8-4ed4-aa0e-f9998b78c4c1', 'b933f568-5d90-47bd-be30-7617c3c70471', '4defad8a-480d-45c1-a0e0-9fe3587916fb'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:00 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1534b7eb-705d-4483-ab7b-dca537514509 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b" returned: 0 in 0.432s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1534b7eb-705d-4483-ab7b-dca537514509 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.2628d905-7b76-42e3-8582-bf48eb6cc5c1 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:00 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.2628d905-7b76-42e3-8582-bf48eb6cc5c1 1G Jul 22 12:26:00 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-004b50c1-55eb-488f-bf31-ea7bae6fe80e tempest-VolumeDependencyTests-1587930118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-004b50c1-55eb-488f-bf31-ea7bae6fe80e tempest-VolumeDependencyTests-1587930118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-004b50c1-55eb-488f-bf31-ea7bae6fe80e tempest-VolumeDependencyTests-1587930118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-004b50c1-55eb-488f-bf31-ea7bae6fe80e tempest-VolumeDependencyTests-1587930118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-004b50c1-55eb-488f-bf31-ea7bae6fe80e tempest-VolumeDependencyTests-1587930118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-004b50c1-55eb-488f-bf31-ea7bae6fe80e tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:00 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:26:00 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2c919151-4fd5-4b35-a750-b85055e77a49 tempest-VolumeDependencyTests-1587930118 None] Acquiring lock "cinder-afe06d74-21a2-4b8f-b095-d2f9b2143ced-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2c919151-4fd5-4b35-a750-b85055e77a49 tempest-VolumeDependencyTests-1587930118 None] Lock "cinder-afe06d74-21a2-4b8f-b095-d2f9b2143ced-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2c919151-4fd5-4b35-a750-b85055e77a49 tempest-VolumeDependencyTests-1587930118 None] Acquiring lock "cinder-quobyte-afe06d74-21a2-4b8f-b095-d2f9b2143ced" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2c919151-4fd5-4b35-a750-b85055e77a49 tempest-VolumeDependencyTests-1587930118 None] Lock "cinder-quobyte-afe06d74-21a2-4b8f-b095-d2f9b2143ced" acquired by "delete_volume" :: waited 0.026s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:00 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-004b50c1-55eb-488f-bf31-ea7bae6fe80e tempest-VolumeDependencyTests-1587930118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.355s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-004b50c1-55eb-488f-bf31-ea7bae6fe80e tempest-VolumeDependencyTests-1587930118 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38c379e-2230-42d6-a635-4393a619cc9d]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2c919151-4fd5-4b35-a750-b85055e77a49 tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-afe06d74-21a2-4b8f-b095-d2f9b2143ced {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:00 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-004b50c1-55eb-488f-bf31-ea7bae6fe80e tempest-VolumeDependencyTests-1587930118 None] Deleted volume successfully. Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2c454446-7d10-4969-86f1-105736d6fdac tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-2c20d660-5885-4ac3-8c06-80f5ab91364c-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-004b50c1-55eb-488f-bf31-ea7bae6fe80e tempest-VolumeDependencyTests-1587930118 None] Lock "cinder-a925706e-658d-4e3e-9f05-9a3096f15747-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2c454446-7d10-4969-86f1-105736d6fdac tempest-ProjectReaderTests-831764688 None] Lock "cinder-2c20d660-5885-4ac3-8c06-80f5ab91364c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2c454446-7d10-4969-86f1-105736d6fdac tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-quobyte-e3219689-b330-461d-a898-a833ad90aa41" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2c454446-7d10-4969-86f1-105736d6fdac tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-e3219689-b330-461d-a898-a833ad90aa41" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2c454446-7d10-4969-86f1-105736d6fdac tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-quobyte-2c20d660-5885-4ac3-8c06-80f5ab91364c" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2c454446-7d10-4969-86f1-105736d6fdac tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-2c20d660-5885-4ac3-8c06-80f5ab91364c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-2c454446-7d10-4969-86f1-105736d6fdac tempest-ProjectReaderTests-831764688 None] Deleting offline snapshot 2c20d660-5885-4ac3-8c06-80f5ab91364c of volume e3219689-b330-461d-a898-a833ad90aa41 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-2c454446-7d10-4969-86f1-105736d6fdac tempest-ProjectReaderTests-831764688 None] snapshot_file for this snap is: volume-e3219689-b330-461d-a898-a833ad90aa41.2c20d660-5885-4ac3-8c06-80f5ab91364c {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[16877f1f-4c2d-4e66-abc4-7938f31e3dfa]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2c454446-7d10-4969-86f1-105736d6fdac tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.2c20d660-5885-4ac3-8c06-80f5ab91364c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:01 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-afe06d74-21a2-4b8f-b095-d2f9b2143ced Jul 22 12:26:01 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:01 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1534b7eb-705d-4483-ab7b-dca537514509 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.2628d905-7b76-42e3-8582-bf48eb6cc5c1 1G" returned: 0 in 0.625s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1534b7eb-705d-4483-ab7b-dca537514509 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b14d729d-833d-4301-bc9d-48f74dbfe05b -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.2628d905-7b76-42e3-8582-bf48eb6cc5c1 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:01 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b14d729d-833d-4301-bc9d-48f74dbfe05b -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.2628d905-7b76-42e3-8582-bf48eb6cc5c1 Jul 22 12:26:01 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:01 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.2c20d660-5885-4ac3-8c06-80f5ab91364c Jul 22 12:26:01 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:01 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2c919151-4fd5-4b35-a750-b85055e77a49 tempest-VolumeDependencyTests-1587930118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-afe06d74-21a2-4b8f-b095-d2f9b2143ced" returned: 0 in 0.484s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2c919151-4fd5-4b35-a750-b85055e77a49 tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-afe06d74-21a2-4b8f-b095-d2f9b2143ced {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:01 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-afe06d74-21a2-4b8f-b095-d2f9b2143ced Jul 22 12:26:01 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:01 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1534b7eb-705d-4483-ab7b-dca537514509 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b14d729d-833d-4301-bc9d-48f74dbfe05b -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.2628d905-7b76-42e3-8582-bf48eb6cc5c1" returned: 0 in 0.349s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:01 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-1534b7eb-705d-4483-ab7b-dca537514509 tempest-ProjectMemberTests-872887571 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.2628d905-7b76-42e3-8582-bf48eb6cc5c1 is being set with open permissions: ugo+rw Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1534b7eb-705d-4483-ab7b-dca537514509 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.2628d905-7b76-42e3-8582-bf48eb6cc5c1 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:01 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.2628d905-7b76-42e3-8582-bf48eb6cc5c1 Jul 22 12:26:01 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:01 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2c454446-7d10-4969-86f1-105736d6fdac tempest-ProjectReaderTests-831764688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.2c20d660-5885-4ac3-8c06-80f5ab91364c" returned: 0 in 0.510s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-2c454446-7d10-4969-86f1-105736d6fdac tempest-ProjectReaderTests-831764688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3219689-b330-461d-a898-a833ad90aa41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[78647ea3-83df-45c9-b18b-1bc8648639ff]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2c454446-7d10-4969-86f1-105736d6fdac tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:01 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2c919151-4fd5-4b35-a750-b85055e77a49 tempest-VolumeDependencyTests-1587930118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-afe06d74-21a2-4b8f-b095-d2f9b2143ced" returned: 0 in 0.305s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2c919151-4fd5-4b35-a750-b85055e77a49 tempest-VolumeDependencyTests-1587930118 None] Lock "cinder-quobyte-afe06d74-21a2-4b8f-b095-d2f9b2143ced" released by "delete_volume" :: held 0.842s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:01 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1534b7eb-705d-4483-ab7b-dca537514509 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.2628d905-7b76-42e3-8582-bf48eb6cc5c1" returned: 0 in 0.277s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:01 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41 Jul 22 12:26:01 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1534b7eb-705d-4483-ab7b-dca537514509 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:01 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.info Jul 22 12:26:01 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-2c919151-4fd5-4b35-a750-b85055e77a49 tempest-VolumeDependencyTests-1587930118 None] Created reservations ['c0a25e1d-95d1-47fc-9808-0621f9bef58a', 'ae9e17eb-3603-460f-86aa-c407326f9151', '578534dd-bf35-4d9e-a6a6-354fdea0cb1c', '40e04c4d-4269-46da-9264-80f587d7cf9f'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2c919151-4fd5-4b35-a750-b85055e77a49 tempest-VolumeDependencyTests-1587930118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2c919151-4fd5-4b35-a750-b85055e77a49 tempest-VolumeDependencyTests-1587930118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2c919151-4fd5-4b35-a750-b85055e77a49 tempest-VolumeDependencyTests-1587930118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2c919151-4fd5-4b35-a750-b85055e77a49 tempest-VolumeDependencyTests-1587930118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2c919151-4fd5-4b35-a750-b85055e77a49 tempest-VolumeDependencyTests-1587930118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2c919151-4fd5-4b35-a750-b85055e77a49 tempest-VolumeDependencyTests-1587930118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:02 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:26:02 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:02 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1534b7eb-705d-4483-ab7b-dca537514509 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.info" returned: 0 in 0.362s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:02 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-1534b7eb-705d-4483-ab7b-dca537514509 tempest-ProjectMemberTests-872887571 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.info is being set with open permissions: ugo+rw Jul 22 12:26:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1534b7eb-705d-4483-ab7b-dca537514509 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:02 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.info Jul 22 12:26:02 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:02 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2c454446-7d10-4969-86f1-105736d6fdac tempest-ProjectReaderTests-831764688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41" returned: 0 in 0.589s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2c454446-7d10-4969-86f1-105736d6fdac tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.2c20d660-5885-4ac3-8c06-80f5ab91364c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:02 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.2c20d660-5885-4ac3-8c06-80f5ab91364c Jul 22 12:26:02 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:02 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2c919151-4fd5-4b35-a750-b85055e77a49 tempest-VolumeDependencyTests-1587930118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.465s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:02 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-2c919151-4fd5-4b35-a750-b85055e77a49 tempest-VolumeDependencyTests-1587930118 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:26:02 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-2c919151-4fd5-4b35-a750-b85055e77a49 tempest-VolumeDependencyTests-1587930118 None] Deleted volume successfully. Jul 22 12:26:02 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2c919151-4fd5-4b35-a750-b85055e77a49 tempest-VolumeDependencyTests-1587930118 None] Lock "cinder-afe06d74-21a2-4b8f-b095-d2f9b2143ced-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:02 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1534b7eb-705d-4483-ab7b-dca537514509 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.info" returned: 0 in 0.334s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1534b7eb-705d-4483-ab7b-dca537514509 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.499s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:02 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-1534b7eb-705d-4483-ab7b-dca537514509 tempest-ProjectMemberTests-872887571 None] Create snapshot completed successfully Jul 22 12:26:02 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2c454446-7d10-4969-86f1-105736d6fdac tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.2c20d660-5885-4ac3-8c06-80f5ab91364c" returned: 0 in 0.538s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2c454446-7d10-4969-86f1-105736d6fdac tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.2c20d660-5885-4ac3-8c06-80f5ab91364c {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:02 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.2c20d660-5885-4ac3-8c06-80f5ab91364c Jul 22 12:26:02 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2c454446-7d10-4969-86f1-105736d6fdac tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41.2c20d660-5885-4ac3-8c06-80f5ab91364c" returned: 0 in 0.300s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:03 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:03 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2c454446-7d10-4969-86f1-105736d6fdac tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-2c20d660-5885-4ac3-8c06-80f5ab91364c" released by "_delete_snapshot" :: held 2.081s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:03 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2c454446-7d10-4969-86f1-105736d6fdac tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-e3219689-b330-461d-a898-a833ad90aa41" released by "delete_snapshot" :: held 2.113s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:03 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b783da05-4a8b-4856-9e3d-93f671ed027b tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-2628d905-7b76-42e3-8582-bf48eb6cc5c1-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:03 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b783da05-4a8b-4856-9e3d-93f671ed027b tempest-ProjectMemberTests-872887571 None] Lock "cinder-2628d905-7b76-42e3-8582-bf48eb6cc5c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:03 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b783da05-4a8b-4856-9e3d-93f671ed027b tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-b14d729d-833d-4301-bc9d-48f74dbfe05b" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:03 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b783da05-4a8b-4856-9e3d-93f671ed027b tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-b14d729d-833d-4301-bc9d-48f74dbfe05b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:03 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b783da05-4a8b-4856-9e3d-93f671ed027b tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-2628d905-7b76-42e3-8582-bf48eb6cc5c1" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:03 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b783da05-4a8b-4856-9e3d-93f671ed027b tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-2628d905-7b76-42e3-8582-bf48eb6cc5c1" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:03 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-b783da05-4a8b-4856-9e3d-93f671ed027b tempest-ProjectMemberTests-872887571 None] Deleting offline snapshot 2628d905-7b76-42e3-8582-bf48eb6cc5c1 of volume b14d729d-833d-4301-bc9d-48f74dbfe05b {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:26:03 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-b783da05-4a8b-4856-9e3d-93f671ed027b tempest-ProjectMemberTests-872887571 None] snapshot_file for this snap is: volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.2628d905-7b76-42e3-8582-bf48eb6cc5c1 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:26:03 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-2c454446-7d10-4969-86f1-105736d6fdac tempest-ProjectReaderTests-831764688 None] Created reservations ['f5e50d33-0094-4521-b078-7a4b448e2f15', 'ae15fd8e-b8f2-4a4c-b92a-daa0410435b8', 'd5ac3c89-889a-4439-a8a0-2d7cbd27c3e5', '9e3454ef-e0bd-470c-8ac5-d57c38596d01'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:03 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[2579e495-6fc9-4253-9722-7f2d4ddbae91]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b783da05-4a8b-4856-9e3d-93f671ed027b tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.2628d905-7b76-42e3-8582-bf48eb6cc5c1 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:03 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-2c454446-7d10-4969-86f1-105736d6fdac tempest-ProjectReaderTests-831764688 None] Delete snapshot completed successfully. Jul 22 12:26:03 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2c454446-7d10-4969-86f1-105736d6fdac tempest-ProjectReaderTests-831764688 None] Lock "cinder-2c20d660-5885-4ac3-8c06-80f5ab91364c-delete_snapshot" released by "delete_snapshot" :: held 2.345s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:03 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.2628d905-7b76-42e3-8582-bf48eb6cc5c1 Jul 22 12:26:03 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:03 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b783da05-4a8b-4856-9e3d-93f671ed027b tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.2628d905-7b76-42e3-8582-bf48eb6cc5c1" returned: 0 in 0.408s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:03 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-b783da05-4a8b-4856-9e3d-93f671ed027b tempest-ProjectMemberTests-872887571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b14d729d-833d-4301-bc9d-48f74dbfe05b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:26:03 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f73a35e-4945-408e-bcee-bf0230d48f0f]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b783da05-4a8b-4856-9e3d-93f671ed027b tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:03 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b Jul 22 12:26:03 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:04 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b783da05-4a8b-4856-9e3d-93f671ed027b tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b" returned: 0 in 0.404s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b783da05-4a8b-4856-9e3d-93f671ed027b tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.2628d905-7b76-42e3-8582-bf48eb6cc5c1 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:04 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.2628d905-7b76-42e3-8582-bf48eb6cc5c1 Jul 22 12:26:04 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3417cd2b-1e5e-41ea-be99-517312e3d569 tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-e3219689-b330-461d-a898-a833ad90aa41-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3417cd2b-1e5e-41ea-be99-517312e3d569 tempest-ProjectReaderTests-831764688 None] Lock "cinder-e3219689-b330-461d-a898-a833ad90aa41-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3417cd2b-1e5e-41ea-be99-517312e3d569 tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-quobyte-e3219689-b330-461d-a898-a833ad90aa41" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3417cd2b-1e5e-41ea-be99-517312e3d569 tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-e3219689-b330-461d-a898-a833ad90aa41" acquired by "delete_volume" :: waited 0.034s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:04 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48d41da-8417-4080-87c1-293e4b2b0dd1]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3417cd2b-1e5e-41ea-be99-517312e3d569 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:04 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b783da05-4a8b-4856-9e3d-93f671ed027b tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.2628d905-7b76-42e3-8582-bf48eb6cc5c1" returned: 0 in 0.446s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b783da05-4a8b-4856-9e3d-93f671ed027b tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.2628d905-7b76-42e3-8582-bf48eb6cc5c1 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:04 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41 Jul 22 12:26:04 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:04 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.2628d905-7b76-42e3-8582-bf48eb6cc5c1 Jul 22 12:26:04 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:04 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-b783da05-4a8b-4856-9e3d-93f671ed027b tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b.2628d905-7b76-42e3-8582-bf48eb6cc5c1" returned: 0 in 0.295s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b783da05-4a8b-4856-9e3d-93f671ed027b tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-2628d905-7b76-42e3-8582-bf48eb6cc5c1" released by "_delete_snapshot" :: held 1.705s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:04 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3417cd2b-1e5e-41ea-be99-517312e3d569 tempest-ProjectReaderTests-831764688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41" returned: 0 in 0.487s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3417cd2b-1e5e-41ea-be99-517312e3d569 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b783da05-4a8b-4856-9e3d-93f671ed027b tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-b14d729d-833d-4301-bc9d-48f74dbfe05b" released by "delete_snapshot" :: held 1.762s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:04 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41 Jul 22 12:26:04 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:05 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-b783da05-4a8b-4856-9e3d-93f671ed027b tempest-ProjectMemberTests-872887571 None] Created reservations ['a859dd2a-d3e9-4abd-aef5-975454747ec5', 'b8acc247-48db-4b10-98c3-79fbabb2bca6', '7d8c4359-4ac5-4cd0-a9a2-6cbf72290594', '28e5656f-fae7-4ee8-9a19-a105b7417de4'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:05 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-b783da05-4a8b-4856-9e3d-93f671ed027b tempest-ProjectMemberTests-872887571 None] Delete snapshot completed successfully. Jul 22 12:26:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-b783da05-4a8b-4856-9e3d-93f671ed027b tempest-ProjectMemberTests-872887571 None] Lock "cinder-2628d905-7b76-42e3-8582-bf48eb6cc5c1-delete_snapshot" released by "delete_snapshot" :: held 2.002s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:05 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3417cd2b-1e5e-41ea-be99-517312e3d569 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-e3219689-b330-461d-a898-a833ad90aa41" returned: 0 in 0.309s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3417cd2b-1e5e-41ea-be99-517312e3d569 tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-e3219689-b330-461d-a898-a833ad90aa41" released by "delete_volume" :: held 0.878s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:05 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-3417cd2b-1e5e-41ea-be99-517312e3d569 tempest-ProjectReaderTests-831764688 None] Created reservations ['bf8c3c74-f3b0-4f6d-8045-1eff0f7d86fd', '24b4b92b-8ed4-4b0a-b0ba-783a8afa4f01', 'faf023f8-484f-4e6d-a923-2671327d3c4b', '1d585630-c2a1-45f1-bdd8-ef01bbf1e5d3'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3417cd2b-1e5e-41ea-be99-517312e3d569 tempest-ProjectReaderTests-831764688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3417cd2b-1e5e-41ea-be99-517312e3d569 tempest-ProjectReaderTests-831764688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:05 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3417cd2b-1e5e-41ea-be99-517312e3d569 tempest-ProjectReaderTests-831764688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:05 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3417cd2b-1e5e-41ea-be99-517312e3d569 tempest-ProjectReaderTests-831764688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3417cd2b-1e5e-41ea-be99-517312e3d569 tempest-ProjectReaderTests-831764688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3417cd2b-1e5e-41ea-be99-517312e3d569 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d12ff434-36bb-40f7-8543-2536e3543312 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-b14d729d-833d-4301-bc9d-48f74dbfe05b-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:05 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:26:05 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d12ff434-36bb-40f7-8543-2536e3543312 tempest-ProjectMemberTests-872887571 None] Lock "cinder-b14d729d-833d-4301-bc9d-48f74dbfe05b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d12ff434-36bb-40f7-8543-2536e3543312 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-b14d729d-833d-4301-bc9d-48f74dbfe05b" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d12ff434-36bb-40f7-8543-2536e3543312 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-b14d729d-833d-4301-bc9d-48f74dbfe05b" acquired by "delete_volume" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:05 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[569c2065-f2bc-4ebd-82cc-ee137f57fb5f]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d12ff434-36bb-40f7-8543-2536e3543312 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:05 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b Jul 22 12:26:05 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:05 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3417cd2b-1e5e-41ea-be99-517312e3d569 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.320s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:05 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-3417cd2b-1e5e-41ea-be99-517312e3d569 tempest-ProjectReaderTests-831764688 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:26:05 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-3417cd2b-1e5e-41ea-be99-517312e3d569 tempest-ProjectReaderTests-831764688 None] Deleted volume successfully. Jul 22 12:26:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3417cd2b-1e5e-41ea-be99-517312e3d569 tempest-ProjectReaderTests-831764688 None] Lock "cinder-e3219689-b330-461d-a898-a833ad90aa41-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:06 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d12ff434-36bb-40f7-8543-2536e3543312 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b" returned: 0 in 0.454s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d12ff434-36bb-40f7-8543-2536e3543312 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:06 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b Jul 22 12:26:06 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:26:06 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Flow 'volume_create_manager' (05a2c835-7a43-4e65-870b-27404319643c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac0293c8-6b4f-4e96-ac47-2d8f4571b99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d12ff434-36bb-40f7-8543-2536e3543312 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-b14d729d-833d-4301-bc9d-48f74dbfe05b" returned: 0 in 0.346s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d12ff434-36bb-40f7-8543-2536e3543312 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-b14d729d-833d-4301-bc9d-48f74dbfe05b" released by "delete_volume" :: held 0.879s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac0293c8-6b4f-4e96-ac47-2d8f4571b99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1747014742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6d72cf4-a351-4490-b7e6-83155779a759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f63399c06fe47509996d028e2e02634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:26:06Z,use_quota=True,user_id='bbe9dbd345eb4efc802016ed89e01d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf404ecb-ff9f-464b-9a97-c6ac05853aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf404ecb-ff9f-464b-9a97-c6ac05853aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68519537-4eec-4003-af43-216248a9abdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68519537-4eec-4003-af43-216248a9abdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6d72cf4-a351-4490-b7e6-83155779a759', 'volume_name': 'volume-d6d72cf4-a351-4490-b7e6-83155779a759', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7025faa9-bbf1-406e-9a11-0ca7a3500e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7025faa9-bbf1-406e-9a11-0ca7a3500e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a79a47d-3ecf-4e63-a9d8-38c530951bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:06 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Volume d6d72cf4-a351-4490-b7e6-83155779a759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6d72cf4-a351-4490-b7e6-83155779a759', 'volume_size': 1} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1747014742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6d72cf4-a351-4490-b7e6-83155779a759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f63399c06fe47509996d028e2e02634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:26:06Z,use_quota=True,user_id='bbe9dbd345eb4efc802016ed89e01d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Creating volume d6d72cf4-a351-4490-b7e6-83155779a759 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:26:06 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:06 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759 1073741824 Jul 22 12:26:06 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-d12ff434-36bb-40f7-8543-2536e3543312 tempest-ProjectMemberTests-872887571 None] Created reservations ['0502da94-cd18-48ea-84ea-273ba693a203', 'cefde3b8-6a04-4f6f-bd8d-ad851f0cc5c8', '6576a5ff-ac32-4441-aaa5-c38577a28bf5', 'b38176aa-a751-49f1-b17d-02cda3a1dce9'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d12ff434-36bb-40f7-8543-2536e3543312 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d12ff434-36bb-40f7-8543-2536e3543312 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d12ff434-36bb-40f7-8543-2536e3543312 tempest-ProjectMemberTests-872887571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d12ff434-36bb-40f7-8543-2536e3543312 tempest-ProjectMemberTests-872887571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d12ff434-36bb-40f7-8543-2536e3543312 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d12ff434-36bb-40f7-8543-2536e3543312 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:06 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:26:06 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:06 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d12ff434-36bb-40f7-8543-2536e3543312 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.296s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-d12ff434-36bb-40f7-8543-2536e3543312 tempest-ProjectMemberTests-872887571 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:26:06 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d12ff434-36bb-40f7-8543-2536e3543312 tempest-ProjectMemberTests-872887571 None] Deleted volume successfully. Jul 22 12:26:06 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d12ff434-36bb-40f7-8543-2536e3543312 tempest-ProjectMemberTests-872887571 None] Lock "cinder-b14d729d-833d-4301-bc9d-48f74dbfe05b-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:07 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759 1073741824" returned: 0 in 0.567s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:07 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759 Jul 22 12:26:07 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:07 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759" returned: 0 in 0.313s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a79a47d-3ecf-4e63-a9d8-38c530951bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6d72cf4-a351-4490-b7e6-83155779a759', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20992900-d345-483f-824b-105970623072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:07 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Volume volume-d6d72cf4-a351-4490-b7e6-83155779a759 (d6d72cf4-a351-4490-b7e6-83155779a759): created successfully Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20992900-d345-483f-824b-105970623072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Flow 'volume_create_manager' (05a2c835-7a43-4e65-870b-27404319643c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:26:07 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-50da1415-59ca-4bda-804b-3d1bc18849da tempest-ProjectReaderTests-831764688 None] Created volume successfully. Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Flow 'volume_create_manager' (3382f6eb-c903-486e-8e0f-15b1062c8b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0397f588-f4fe-4d9c-a119-955a8ae5a417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0397f588-f4fe-4d9c-a119-955a8ae5a417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2143157606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ebc5de9-3a05-4405-a0a2-d3b1157e6916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89707e5757184c76b39c42c3553f59c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:26:07Z,use_quota=True,user_id='edd7857f9fd44201b44894c8b9b98d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac942ec-5df9-4f04-bbc1-639bd4ce1552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac942ec-5df9-4f04-bbc1-639bd4ce1552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed4231e-34c6-4ccd-b092-f21fa40b43f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed4231e-34c6-4ccd-b092-f21fa40b43f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ebc5de9-3a05-4405-a0a2-d3b1157e6916', 'volume_name': 'volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca096f18-f62b-462b-94e4-b8b9883b1380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca096f18-f62b-462b-94e4-b8b9883b1380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7eb6762-a6e1-4aa4-9c95-0b97c7232a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:07 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Volume 9ebc5de9-3a05-4405-a0a2-d3b1157e6916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916', 'volume_size': 1} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2143157606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ebc5de9-3a05-4405-a0a2-d3b1157e6916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89707e5757184c76b39c42c3553f59c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:26:07Z,use_quota=True,user_id='edd7857f9fd44201b44894c8b9b98d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Creating volume 9ebc5de9-3a05-4405-a0a2-d3b1157e6916 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:26:07 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:26:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:07 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916 1073741824 Jul 22 12:26:07 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:08 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916 1073741824" returned: 0 in 0.482s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:08 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916 Jul 22 12:26:08 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:08 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916" returned: 0 in 0.311s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:26:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7eb6762-a6e1-4aa4-9c95-0b97c7232a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cacbfeeb-3625-48fd-9d54-aebc92bdace8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:08 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Volume volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916 (9ebc5de9-3a05-4405-a0a2-d3b1157e6916): created successfully Jul 22 12:26:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cacbfeeb-3625-48fd-9d54-aebc92bdace8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Flow 'volume_create_manager' (3382f6eb-c903-486e-8e0f-15b1062c8b45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:26:08 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-f3b0ee47-94b3-43f3-9160-3c79c4788e48 tempest-ProjectMemberTests-872887571 None] Created volume successfully. Jul 22 12:26:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-95bf016a-1da0-4599-aaa2-277e3cd28dc5 tempest-ProjectReaderTests-831764688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-95bf016a-1da0-4599-aaa2-277e3cd28dc5 tempest-ProjectReaderTests-831764688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-95bf016a-1da0-4599-aaa2-277e3cd28dc5 tempest-ProjectReaderTests-831764688 None] Creating offline snapshot e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629 of volume d6d72cf4-a351-4490-b7e6-83155779a759 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:26:08 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dcc4c8-e8b8-41c5-9458-ff85908cdbd2]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95bf016a-1da0-4599-aaa2-277e3cd28dc5 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:08 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759 Jul 22 12:26:08 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:08 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95bf016a-1da0-4599-aaa2-277e3cd28dc5 tempest-ProjectReaderTests-831764688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759" returned: 0 in 0.385s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95bf016a-1da0-4599-aaa2-277e3cd28dc5 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:08 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629 1G Jul 22 12:26:08 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:09 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95bf016a-1da0-4599-aaa2-277e3cd28dc5 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629 1G" returned: 0 in 0.549s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95bf016a-1da0-4599-aaa2-277e3cd28dc5 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6d72cf4-a351-4490-b7e6-83155779a759 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:09 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6d72cf4-a351-4490-b7e6-83155779a759 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629 Jul 22 12:26:09 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-beefa430-7925-4339-a827-61ee08c742e3 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:09 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95bf016a-1da0-4599-aaa2-277e3cd28dc5 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6d72cf4-a351-4490-b7e6-83155779a759 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629" returned: 0 in 0.440s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:09 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-95bf016a-1da0-4599-aaa2-277e3cd28dc5 tempest-ProjectReaderTests-831764688 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629 is being set with open permissions: ugo+rw Jul 22 12:26:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95bf016a-1da0-4599-aaa2-277e3cd28dc5 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:09 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629 Jul 22 12:26:09 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:10 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95bf016a-1da0-4599-aaa2-277e3cd28dc5 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629" returned: 0 in 0.298s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95bf016a-1da0-4599-aaa2-277e3cd28dc5 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:10 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.info Jul 22 12:26:10 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:10 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95bf016a-1da0-4599-aaa2-277e3cd28dc5 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.info" returned: 0 in 0.265s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:10 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-95bf016a-1da0-4599-aaa2-277e3cd28dc5 tempest-ProjectReaderTests-831764688 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.info is being set with open permissions: ugo+rw Jul 22 12:26:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95bf016a-1da0-4599-aaa2-277e3cd28dc5 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:10 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.info Jul 22 12:26:10 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:10 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-95bf016a-1da0-4599-aaa2-277e3cd28dc5 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.info" returned: 0 in 0.277s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-95bf016a-1da0-4599-aaa2-277e3cd28dc5 tempest-ProjectReaderTests-831764688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.314s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-beefa430-7925-4339-a827-61ee08c742e3 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.152s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:10 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-beefa430-7925-4339-a827-61ee08c742e3 tempest-ProjectMemberTests-872887571 None] Creating offline snapshot 34cc1af1-f924-4843-8666-5fe57a3e1451 of volume 9ebc5de9-3a05-4405-a0a2-d3b1157e6916 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:26:10 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-95bf016a-1da0-4599-aaa2-277e3cd28dc5 tempest-ProjectReaderTests-831764688 None] Create snapshot completed successfully Jul 22 12:26:10 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[10417551-323a-4c03-b465-073fb3006f8b]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-beefa430-7925-4339-a827-61ee08c742e3 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:10 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916 Jul 22 12:26:10 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:11 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-beefa430-7925-4339-a827-61ee08c742e3 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916" returned: 0 in 0.425s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-beefa430-7925-4339-a827-61ee08c742e3 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.34cc1af1-f924-4843-8666-5fe57a3e1451 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:11 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.34cc1af1-f924-4843-8666-5fe57a3e1451 1G Jul 22 12:26:11 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:11 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5cc196e-a063-4acc-9f59-1b65b681b1f6 tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:11 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5cc196e-a063-4acc-9f59-1b65b681b1f6 tempest-ProjectReaderTests-831764688 None] Lock "cinder-e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:11 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5cc196e-a063-4acc-9f59-1b65b681b1f6 tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-quobyte-d6d72cf4-a351-4490-b7e6-83155779a759" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:11 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5cc196e-a063-4acc-9f59-1b65b681b1f6 tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-d6d72cf4-a351-4490-b7e6-83155779a759" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:11 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5cc196e-a063-4acc-9f59-1b65b681b1f6 tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-quobyte-e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:11 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5cc196e-a063-4acc-9f59-1b65b681b1f6 tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-d5cc196e-a063-4acc-9f59-1b65b681b1f6 tempest-ProjectReaderTests-831764688 None] Deleting offline snapshot e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629 of volume d6d72cf4-a351-4490-b7e6-83155779a759 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:26:11 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-d5cc196e-a063-4acc-9f59-1b65b681b1f6 tempest-ProjectReaderTests-831764688 None] snapshot_file for this snap is: volume-d6d72cf4-a351-4490-b7e6-83155779a759.e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:26:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-beefa430-7925-4339-a827-61ee08c742e3 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.34cc1af1-f924-4843-8666-5fe57a3e1451 1G" returned: 0 in 0.572s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-beefa430-7925-4339-a827-61ee08c742e3 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.34cc1af1-f924-4843-8666-5fe57a3e1451 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:11 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[414b1a3a-c5c2-42dd-8cab-82108846d637]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5cc196e-a063-4acc-9f59-1b65b681b1f6 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:11 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.34cc1af1-f924-4843-8666-5fe57a3e1451 Jul 22 12:26:11 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:12 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629 Jul 22 12:26:12 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:12 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-beefa430-7925-4339-a827-61ee08c742e3 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.34cc1af1-f924-4843-8666-5fe57a3e1451" returned: 0 in 0.333s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:12 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-beefa430-7925-4339-a827-61ee08c742e3 tempest-ProjectMemberTests-872887571 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.34cc1af1-f924-4843-8666-5fe57a3e1451 is being set with open permissions: ugo+rw Jul 22 12:26:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-beefa430-7925-4339-a827-61ee08c742e3 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.34cc1af1-f924-4843-8666-5fe57a3e1451 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:12 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.34cc1af1-f924-4843-8666-5fe57a3e1451 Jul 22 12:26:12 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:12 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5cc196e-a063-4acc-9f59-1b65b681b1f6 tempest-ProjectReaderTests-831764688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629" returned: 0 in 0.537s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-d5cc196e-a063-4acc-9f59-1b65b681b1f6 tempest-ProjectReaderTests-831764688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6d72cf4-a351-4490-b7e6-83155779a759(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:26:12 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90a73af-e6b1-4322-a9dd-c46e07c41257]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5cc196e-a063-4acc-9f59-1b65b681b1f6 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:12 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-beefa430-7925-4339-a827-61ee08c742e3 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.34cc1af1-f924-4843-8666-5fe57a3e1451" returned: 0 in 0.374s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-beefa430-7925-4339-a827-61ee08c742e3 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:12 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759 Jul 22 12:26:12 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:12 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.info Jul 22 12:26:12 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:12 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-beefa430-7925-4339-a827-61ee08c742e3 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.info" returned: 0 in 0.336s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:12 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-beefa430-7925-4339-a827-61ee08c742e3 tempest-ProjectMemberTests-872887571 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.info is being set with open permissions: ugo+rw Jul 22 12:26:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-beefa430-7925-4339-a827-61ee08c742e3 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:12 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.info Jul 22 12:26:12 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:13 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5cc196e-a063-4acc-9f59-1b65b681b1f6 tempest-ProjectReaderTests-831764688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759" returned: 0 in 0.561s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5cc196e-a063-4acc-9f59-1b65b681b1f6 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:26:13 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629 Jul 22 12:26:13 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Flow 'volume_create_manager' (5dbaa1bb-691b-4738-a513-f94875476339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (538254d1-5cfe-4d9b-bca1-0e506312cb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (538254d1-5cfe-4d9b-bca1-0e506312cb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1346875434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0c79ae2-2855-4c81-93b7-ca924a598d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e797d990be4721a2dae72fe19d9500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:26:13Z,use_quota=True,user_id='2ec694c8d8fe4c5c9910deb48046ac15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872b407a-8261-43fb-abb9-e14ff1aa9acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872b407a-8261-43fb-abb9-e14ff1aa9acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb58e573-60f0-4325-85c4-29ce0a0b1866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb58e573-60f0-4325-85c4-29ce0a0b1866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0c79ae2-2855-4c81-93b7-ca924a598d96', 'volume_name': 'volume-f0c79ae2-2855-4c81-93b7-ca924a598d96', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8fcfc2c-6aad-444b-b6d8-53ad6f92bbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8fcfc2c-6aad-444b-b6d8-53ad6f92bbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a98e51-4efd-4172-acc1-a13ecd067fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:13 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Volume f0c79ae2-2855-4c81-93b7-ca924a598d96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0c79ae2-2855-4c81-93b7-ca924a598d96', 'volume_size': 1} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:13 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-beefa430-7925-4339-a827-61ee08c742e3 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.info" returned: 0 in 0.300s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-beefa430-7925-4339-a827-61ee08c742e3 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.451s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.109s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1346875434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0c79ae2-2855-4c81-93b7-ca924a598d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e797d990be4721a2dae72fe19d9500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:26:13Z,use_quota=True,user_id='2ec694c8d8fe4c5c9910deb48046ac15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Creating volume f0c79ae2-2855-4c81-93b7-ca924a598d96 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:26:13 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f0c79ae2-2855-4c81-93b7-ca924a598d96 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:13 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f0c79ae2-2855-4c81-93b7-ca924a598d96 1073741824 Jul 22 12:26:13 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:13 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-beefa430-7925-4339-a827-61ee08c742e3 tempest-ProjectMemberTests-872887571 None] Create snapshot completed successfully Jul 22 12:26:13 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5cc196e-a063-4acc-9f59-1b65b681b1f6 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629" returned: 0 in 0.415s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5cc196e-a063-4acc-9f59-1b65b681b1f6 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:13 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629 Jul 22 12:26:13 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:13 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d5cc196e-a063-4acc-9f59-1b65b681b1f6 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759.e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629" returned: 0 in 0.280s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5cc196e-a063-4acc-9f59-1b65b681b1f6 tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629" released by "_delete_snapshot" :: held 1.914s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5cc196e-a063-4acc-9f59-1b65b681b1f6 tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-d6d72cf4-a351-4490-b7e6-83155779a759" released by "delete_snapshot" :: held 1.938s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:13 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f0c79ae2-2855-4c81-93b7-ca924a598d96 1073741824" returned: 0 in 0.501s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f0c79ae2-2855-4c81-93b7-ca924a598d96 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-d5cc196e-a063-4acc-9f59-1b65b681b1f6 tempest-ProjectReaderTests-831764688 None] Created reservations ['a120b597-7851-4009-8ebe-2e3720730e33', '32e6ab79-26cb-4800-9a46-a0aebc858ae2', '2707d67b-1be1-4a8d-a2e3-810e3c158f38', '2ce0fbcf-1a24-4805-8b0a-745d1d3b6d21'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:13 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f0c79ae2-2855-4c81-93b7-ca924a598d96 Jul 22 12:26:13 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7c3f2efa-3efc-4a07-a7b9-884d90e81234 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-34cc1af1-f924-4843-8666-5fe57a3e1451-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:13 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d5cc196e-a063-4acc-9f59-1b65b681b1f6 tempest-ProjectReaderTests-831764688 None] Delete snapshot completed successfully. Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d5cc196e-a063-4acc-9f59-1b65b681b1f6 tempest-ProjectReaderTests-831764688 None] Lock "cinder-e23ce58c-0d42-4aa0-bfcc-2d68cdcc4629-delete_snapshot" released by "delete_snapshot" :: held 2.192s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7c3f2efa-3efc-4a07-a7b9-884d90e81234 tempest-ProjectMemberTests-872887571 None] Lock "cinder-34cc1af1-f924-4843-8666-5fe57a3e1451-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7c3f2efa-3efc-4a07-a7b9-884d90e81234 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-9ebc5de9-3a05-4405-a0a2-d3b1157e6916" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:14 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7c3f2efa-3efc-4a07-a7b9-884d90e81234 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-9ebc5de9-3a05-4405-a0a2-d3b1157e6916" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:14 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7c3f2efa-3efc-4a07-a7b9-884d90e81234 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-34cc1af1-f924-4843-8666-5fe57a3e1451" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:14 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7c3f2efa-3efc-4a07-a7b9-884d90e81234 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-34cc1af1-f924-4843-8666-5fe57a3e1451" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-7c3f2efa-3efc-4a07-a7b9-884d90e81234 tempest-ProjectMemberTests-872887571 None] Deleting offline snapshot 34cc1af1-f924-4843-8666-5fe57a3e1451 of volume 9ebc5de9-3a05-4405-a0a2-d3b1157e6916 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:26:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-7c3f2efa-3efc-4a07-a7b9-884d90e81234 tempest-ProjectMemberTests-872887571 None] snapshot_file for this snap is: volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.34cc1af1-f924-4843-8666-5fe57a3e1451 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:26:14 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5f946f-ac7e-4d26-aa44-d842febcb2f7]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7c3f2efa-3efc-4a07-a7b9-884d90e81234 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.34cc1af1-f924-4843-8666-5fe57a3e1451 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:14 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f0c79ae2-2855-4c81-93b7-ca924a598d96" returned: 0 in 0.333s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:26:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a98e51-4efd-4172-acc1-a13ecd067fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0c79ae2-2855-4c81-93b7-ca924a598d96', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25d5ee3-16e1-4d97-a4ab-d7b642ba0a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:14 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.34cc1af1-f924-4843-8666-5fe57a3e1451 Jul 22 12:26:14 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:14 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Volume volume-f0c79ae2-2855-4c81-93b7-ca924a598d96 (f0c79ae2-2855-4c81-93b7-ca924a598d96): created successfully Jul 22 12:26:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25d5ee3-16e1-4d97-a4ab-d7b642ba0a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:14 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Flow 'volume_create_manager' (5dbaa1bb-691b-4738-a513-f94875476339) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:26:14 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e8299e57-efef-40cb-a667-90eabd0ac6e7 tempest-ProjectReaderTests-791416801 None] Created volume successfully. Jul 22 12:26:14 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7c3f2efa-3efc-4a07-a7b9-884d90e81234 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.34cc1af1-f924-4843-8666-5fe57a3e1451" returned: 0 in 0.384s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:14 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-7c3f2efa-3efc-4a07-a7b9-884d90e81234 tempest-ProjectMemberTests-872887571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:26:14 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd518c6-127e-4d43-8a04-96305e2f14d1]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7c3f2efa-3efc-4a07-a7b9-884d90e81234 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:14 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916 Jul 22 12:26:14 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:14 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7c3f2efa-3efc-4a07-a7b9-884d90e81234 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916" returned: 0 in 0.360s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:14 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7c3f2efa-3efc-4a07-a7b9-884d90e81234 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.34cc1af1-f924-4843-8666-5fe57a3e1451 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:14 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.34cc1af1-f924-4843-8666-5fe57a3e1451 Jul 22 12:26:14 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:15 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d6093c6a-4ebd-4907-b6db-b9c6a9b0d93e tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-d6d72cf4-a351-4490-b7e6-83155779a759-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:15 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d6093c6a-4ebd-4907-b6db-b9c6a9b0d93e tempest-ProjectReaderTests-831764688 None] Lock "cinder-d6d72cf4-a351-4490-b7e6-83155779a759-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:15 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d6093c6a-4ebd-4907-b6db-b9c6a9b0d93e tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-quobyte-d6d72cf4-a351-4490-b7e6-83155779a759" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:15 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d6093c6a-4ebd-4907-b6db-b9c6a9b0d93e tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-d6d72cf4-a351-4490-b7e6-83155779a759" acquired by "delete_volume" :: waited 0.022s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:15 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec353dd-2ab8-4f37-9d29-050c2688211a]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d6093c6a-4ebd-4907-b6db-b9c6a9b0d93e tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:15 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7c3f2efa-3efc-4a07-a7b9-884d90e81234 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.34cc1af1-f924-4843-8666-5fe57a3e1451" returned: 0 in 0.444s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7c3f2efa-3efc-4a07-a7b9-884d90e81234 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.34cc1af1-f924-4843-8666-5fe57a3e1451 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:15 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759 Jul 22 12:26:15 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:15 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.34cc1af1-f924-4843-8666-5fe57a3e1451 Jul 22 12:26:15 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:15 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e96ea64c-7cf2-4141-b5c8-9d9a17021b52 tempest-ProjectReaderTests-791416801 None] Acquiring lock "cinder-f0c79ae2-2855-4c81-93b7-ca924a598d96-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:15 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e96ea64c-7cf2-4141-b5c8-9d9a17021b52 tempest-ProjectReaderTests-791416801 None] Lock "cinder-f0c79ae2-2855-4c81-93b7-ca924a598d96-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:15 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e96ea64c-7cf2-4141-b5c8-9d9a17021b52 tempest-ProjectReaderTests-791416801 None] Acquiring lock "cinder-quobyte-f0c79ae2-2855-4c81-93b7-ca924a598d96" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:15 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e96ea64c-7cf2-4141-b5c8-9d9a17021b52 tempest-ProjectReaderTests-791416801 None] Lock "cinder-quobyte-f0c79ae2-2855-4c81-93b7-ca924a598d96" acquired by "delete_volume" :: waited 0.028s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:15 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f521194b-cdca-4954-96fd-30eca76ef20e]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e96ea64c-7cf2-4141-b5c8-9d9a17021b52 tempest-ProjectReaderTests-791416801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f0c79ae2-2855-4c81-93b7-ca924a598d96 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:15 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7c3f2efa-3efc-4a07-a7b9-884d90e81234 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916.34cc1af1-f924-4843-8666-5fe57a3e1451" returned: 0 in 0.329s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:15 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d6093c6a-4ebd-4907-b6db-b9c6a9b0d93e tempest-ProjectReaderTests-831764688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759" returned: 0 in 0.487s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:15 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d6093c6a-4ebd-4907-b6db-b9c6a9b0d93e tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:15 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7c3f2efa-3efc-4a07-a7b9-884d90e81234 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-34cc1af1-f924-4843-8666-5fe57a3e1451" released by "_delete_snapshot" :: held 1.644s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:15 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7c3f2efa-3efc-4a07-a7b9-884d90e81234 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-9ebc5de9-3a05-4405-a0a2-d3b1157e6916" released by "delete_snapshot" :: held 1.678s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:15 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759 Jul 22 12:26:15 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:15 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f0c79ae2-2855-4c81-93b7-ca924a598d96 Jul 22 12:26:15 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:15 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-7c3f2efa-3efc-4a07-a7b9-884d90e81234 tempest-ProjectMemberTests-872887571 None] Created reservations ['ee9b5f0f-173f-45cc-8a18-f67cd471e087', '0fb64800-ffb2-49ea-abe8-d2f1df9616c8', '37bda5d0-e65a-4b8b-96ad-eb4462c4a86e', '1d3220a1-510f-4bab-a255-c2bcd042266b'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:15 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-7c3f2efa-3efc-4a07-a7b9-884d90e81234 tempest-ProjectMemberTests-872887571 None] Delete snapshot completed successfully. Jul 22 12:26:15 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7c3f2efa-3efc-4a07-a7b9-884d90e81234 tempest-ProjectMemberTests-872887571 None] Lock "cinder-34cc1af1-f924-4843-8666-5fe57a3e1451-delete_snapshot" released by "delete_snapshot" :: held 1.848s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:16 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:16 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d6093c6a-4ebd-4907-b6db-b9c6a9b0d93e tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-d6d72cf4-a351-4490-b7e6-83155779a759" returned: 0 in 0.359s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e96ea64c-7cf2-4141-b5c8-9d9a17021b52 tempest-ProjectReaderTests-791416801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f0c79ae2-2855-4c81-93b7-ca924a598d96" returned: 0 in 0.456s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e96ea64c-7cf2-4141-b5c8-9d9a17021b52 tempest-ProjectReaderTests-791416801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f0c79ae2-2855-4c81-93b7-ca924a598d96 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d6093c6a-4ebd-4907-b6db-b9c6a9b0d93e tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-d6d72cf4-a351-4490-b7e6-83155779a759" released by "delete_volume" :: held 0.928s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:16 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f0c79ae2-2855-4c81-93b7-ca924a598d96 Jul 22 12:26:16 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-d6093c6a-4ebd-4907-b6db-b9c6a9b0d93e tempest-ProjectReaderTests-831764688 None] Created reservations ['4b873900-7234-45e0-addb-4bf6c96d498e', '319d9633-9ca5-42f1-af7b-f08f65000fe2', '4db7c0d3-95ef-4651-b49c-071cf8bc2a9a', '0418ce88-a1f2-4438-9b4d-17e40b228a9a'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d6093c6a-4ebd-4907-b6db-b9c6a9b0d93e tempest-ProjectReaderTests-831764688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d6093c6a-4ebd-4907-b6db-b9c6a9b0d93e tempest-ProjectReaderTests-831764688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d6093c6a-4ebd-4907-b6db-b9c6a9b0d93e tempest-ProjectReaderTests-831764688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d6093c6a-4ebd-4907-b6db-b9c6a9b0d93e tempest-ProjectReaderTests-831764688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d6093c6a-4ebd-4907-b6db-b9c6a9b0d93e tempest-ProjectReaderTests-831764688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d6093c6a-4ebd-4907-b6db-b9c6a9b0d93e tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:16 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8e84cb47-5bd5-49e1-935d-410f88561a3d tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-9ebc5de9-3a05-4405-a0a2-d3b1157e6916-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:16 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8e84cb47-5bd5-49e1-935d-410f88561a3d tempest-ProjectMemberTests-872887571 None] Lock "cinder-9ebc5de9-3a05-4405-a0a2-d3b1157e6916-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8e84cb47-5bd5-49e1-935d-410f88561a3d tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-9ebc5de9-3a05-4405-a0a2-d3b1157e6916" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8e84cb47-5bd5-49e1-935d-410f88561a3d tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-9ebc5de9-3a05-4405-a0a2-d3b1157e6916" acquired by "delete_volume" :: waited 0.038s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:16 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e96ea64c-7cf2-4141-b5c8-9d9a17021b52 tempest-ProjectReaderTests-791416801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-f0c79ae2-2855-4c81-93b7-ca924a598d96" returned: 0 in 0.405s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e96ea64c-7cf2-4141-b5c8-9d9a17021b52 tempest-ProjectReaderTests-791416801 None] Lock "cinder-quobyte-f0c79ae2-2855-4c81-93b7-ca924a598d96" released by "delete_volume" :: held 0.914s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[27849039-31b5-49de-8ac0-d62b2f09b94c]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8e84cb47-5bd5-49e1-935d-410f88561a3d tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-e96ea64c-7cf2-4141-b5c8-9d9a17021b52 tempest-ProjectReaderTests-791416801 None] Created reservations ['097b5279-eb21-4344-8445-c8b8a17670ae', 'a0a86bd9-844e-41ce-b2a0-e1922d7fa1fd', '35c02252-065c-43da-a9c5-268b638efa5f', '5135a4c3-0bb2-4e1d-9a15-934b3a5d3e64'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:16 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d6093c6a-4ebd-4907-b6db-b9c6a9b0d93e tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.371s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-d6093c6a-4ebd-4907-b6db-b9c6a9b0d93e tempest-ProjectReaderTests-831764688 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:26:16 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d6093c6a-4ebd-4907-b6db-b9c6a9b0d93e tempest-ProjectReaderTests-831764688 None] Deleted volume successfully. Jul 22 12:26:16 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916 Jul 22 12:26:16 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d6093c6a-4ebd-4907-b6db-b9c6a9b0d93e tempest-ProjectReaderTests-831764688 None] Lock "cinder-d6d72cf4-a351-4490-b7e6-83155779a759-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e96ea64c-7cf2-4141-b5c8-9d9a17021b52 tempest-ProjectReaderTests-791416801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e96ea64c-7cf2-4141-b5c8-9d9a17021b52 tempest-ProjectReaderTests-791416801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e96ea64c-7cf2-4141-b5c8-9d9a17021b52 tempest-ProjectReaderTests-791416801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-e96ea64c-7cf2-4141-b5c8-9d9a17021b52 tempest-ProjectReaderTests-791416801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-e96ea64c-7cf2-4141-b5c8-9d9a17021b52 tempest-ProjectReaderTests-791416801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e96ea64c-7cf2-4141-b5c8-9d9a17021b52 tempest-ProjectReaderTests-791416801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:16 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:26:16 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:16 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Flow 'volume_create_manager' (26e586a5-0c07-4916-9497-922cdaf47fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:26:16 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c219712-3ea2-4b38-952b-07fb1ce52447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8e84cb47-5bd5-49e1-935d-410f88561a3d tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916" returned: 0 in 0.540s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8e84cb47-5bd5-49e1-935d-410f88561a3d tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:17 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-e96ea64c-7cf2-4141-b5c8-9d9a17021b52 tempest-ProjectReaderTests-791416801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.317s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-e96ea64c-7cf2-4141-b5c8-9d9a17021b52 tempest-ProjectReaderTests-791416801 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:26:17 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916 Jul 22 12:26:17 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c219712-3ea2-4b38-952b-07fb1ce52447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1238863246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d665d4-1cb3-4705-996b-1e4b136f7dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f63399c06fe47509996d028e2e02634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:26:17Z,use_quota=True,user_id='bbe9dbd345eb4efc802016ed89e01d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca8a622d-6aaf-4d06-b743-29c0a566988d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca8a622d-6aaf-4d06-b743-29c0a566988d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d6dce7-798a-44a8-9cf5-5203428a4c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d6dce7-798a-44a8-9cf5-5203428a4c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94d665d4-1cb3-4705-996b-1e4b136f7dd0', 'volume_name': 'volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8770e5d4-5997-4e25-b444-f41a7b452e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8770e5d4-5997-4e25-b444-f41a7b452e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6a3418-22e0-457f-8da7-a687b8883d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:17 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Volume 94d665d4-1cb3-4705-996b-1e4b136f7dd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0', 'volume_size': 1} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1238863246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d665d4-1cb3-4705-996b-1e4b136f7dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f63399c06fe47509996d028e2e02634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:26:17Z,use_quota=True,user_id='bbe9dbd345eb4efc802016ed89e01d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Creating volume 94d665d4-1cb3-4705-996b-1e4b136f7dd0 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:26:17 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:17 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-e96ea64c-7cf2-4141-b5c8-9d9a17021b52 tempest-ProjectReaderTests-791416801 None] Deleted volume successfully. Jul 22 12:26:17 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0 1073741824 Jul 22 12:26:17 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-e96ea64c-7cf2-4141-b5c8-9d9a17021b52 tempest-ProjectReaderTests-791416801 None] Lock "cinder-f0c79ae2-2855-4c81-93b7-ca924a598d96-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:17 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8e84cb47-5bd5-49e1-935d-410f88561a3d tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-9ebc5de9-3a05-4405-a0a2-d3b1157e6916" returned: 0 in 0.297s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8e84cb47-5bd5-49e1-935d-410f88561a3d tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-9ebc5de9-3a05-4405-a0a2-d3b1157e6916" released by "delete_volume" :: held 0.933s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-8e84cb47-5bd5-49e1-935d-410f88561a3d tempest-ProjectMemberTests-872887571 None] Created reservations ['7a78d30f-0626-44a1-bf6e-01e8f4db42fb', '50e835b9-0700-4797-a7ce-159e85daf01a', '006ec944-63d6-4398-8ab6-7210d90efbab', '8e944b45-4bd3-463b-82f2-a62957c399ef'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8e84cb47-5bd5-49e1-935d-410f88561a3d tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8e84cb47-5bd5-49e1-935d-410f88561a3d tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8e84cb47-5bd5-49e1-935d-410f88561a3d tempest-ProjectMemberTests-872887571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-8e84cb47-5bd5-49e1-935d-410f88561a3d tempest-ProjectMemberTests-872887571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-8e84cb47-5bd5-49e1-935d-410f88561a3d tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8e84cb47-5bd5-49e1-935d-410f88561a3d tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:17 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:26:17 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:17 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0 1073741824" returned: 0 in 0.516s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:17 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0 Jul 22 12:26:17 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:17 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-8e84cb47-5bd5-49e1-935d-410f88561a3d tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.301s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-8e84cb47-5bd5-49e1-935d-410f88561a3d tempest-ProjectMemberTests-872887571 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:26:17 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-8e84cb47-5bd5-49e1-935d-410f88561a3d tempest-ProjectMemberTests-872887571 None] Deleted volume successfully. Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-8e84cb47-5bd5-49e1-935d-410f88561a3d tempest-ProjectMemberTests-872887571 None] Lock "cinder-9ebc5de9-3a05-4405-a0a2-d3b1157e6916-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:17 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0" returned: 0 in 0.307s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6a3418-22e0-457f-8da7-a687b8883d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:17 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b080a50c-b7c1-4923-8584-ea7cf4e2e733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:17 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Volume volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0 (94d665d4-1cb3-4705-996b-1e4b136f7dd0): created successfully Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b080a50c-b7c1-4923-8584-ea7cf4e2e733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Flow 'volume_create_manager' (26e586a5-0c07-4916-9497-922cdaf47fe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:26:18 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-dac836a0-e688-4207-a112-3ab72d6a5d21 tempest-ProjectReaderTests-831764688 None] Created volume successfully. Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Flow 'volume_create_manager' (30ff9791-731f-4049-ab50-cbb9b3bdb6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac927e14-8f88-4897-88bc-5e530d14b6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac927e14-8f88-4897-88bc-5e530d14b6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-731008699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677b564c-9ff3-48e3-a65e-6809272908ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e797d990be4721a2dae72fe19d9500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:26:18Z,use_quota=True,user_id='2ec694c8d8fe4c5c9910deb48046ac15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d6fc23-29f5-4249-b965-df3dbafb1ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d6fc23-29f5-4249-b965-df3dbafb1ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0c79e9-2bd9-4105-a578-e6fa69b31733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0c79e9-2bd9-4105-a578-e6fa69b31733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '677b564c-9ff3-48e3-a65e-6809272908ce', 'volume_name': 'volume-677b564c-9ff3-48e3-a65e-6809272908ce', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352416a3-f591-4f37-be42-7962f6329338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352416a3-f591-4f37-be42-7962f6329338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c8a046e-2494-4309-9245-89145712b3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:18 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Volume 677b564c-9ff3-48e3-a65e-6809272908ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-677b564c-9ff3-48e3-a65e-6809272908ce', 'volume_size': 1} Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-731008699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677b564c-9ff3-48e3-a65e-6809272908ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e797d990be4721a2dae72fe19d9500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:26:18Z,use_quota=True,user_id='2ec694c8d8fe4c5c9910deb48046ac15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Creating volume 677b564c-9ff3-48e3-a65e-6809272908ce {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:26:18 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-677b564c-9ff3-48e3-a65e-6809272908ce 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:18 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-677b564c-9ff3-48e3-a65e-6809272908ce 1073741824 Jul 22 12:26:18 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:18 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-677b564c-9ff3-48e3-a65e-6809272908ce 1073741824" returned: 0 in 0.566s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-677b564c-9ff3-48e3-a65e-6809272908ce {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:19 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-677b564c-9ff3-48e3-a65e-6809272908ce Jul 22 12:26:19 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Flow 'volume_create_manager' (6fdcac67-3042-4ae8-a051-8717429d59fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2478dc5f-4443-45a5-b092-61d5a0ac68e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2478dc5f-4443-45a5-b092-61d5a0ac68e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-330661112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac84f222-70fd-4675-b630-9bebcf68042e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89707e5757184c76b39c42c3553f59c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:26:19Z,use_quota=True,user_id='edd7857f9fd44201b44894c8b9b98d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b8d5bf-04e8-4850-a3c9-8ed5e3a18359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b8d5bf-04e8-4850-a3c9-8ed5e3a18359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf366b2f-9e3f-4889-8a16-086a4493dc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf366b2f-9e3f-4889-8a16-086a4493dc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac84f222-70fd-4675-b630-9bebcf68042e', 'volume_name': 'volume-ac84f222-70fd-4675-b630-9bebcf68042e', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97463439-c071-4a61-bb9f-c766ccccbf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97463439-c071-4a61-bb9f-c766ccccbf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1062a2e2-82d4-4028-8776-01f6e7c9aae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:19 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Volume ac84f222-70fd-4675-b630-9bebcf68042e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac84f222-70fd-4675-b630-9bebcf68042e', 'volume_size': 1} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-077992a3-2bfb-4f2d-8242-78c63a1e3224 tempest-ProjectReaderTests-831764688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:19 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-677b564c-9ff3-48e3-a65e-6809272908ce" returned: 0 in 0.342s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.062s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-330661112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac84f222-70fd-4675-b630-9bebcf68042e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89707e5757184c76b39c42c3553f59c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:26:19Z,use_quota=True,user_id='edd7857f9fd44201b44894c8b9b98d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Creating volume ac84f222-70fd-4675-b630-9bebcf68042e {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:26:19 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:19 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e 1073741824 Jul 22 12:26:19 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c8a046e-2494-4309-9245-89145712b3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-677b564c-9ff3-48e3-a65e-6809272908ce', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd1cf03-74ce-413d-bfc9-4b659c0404e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:19 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Volume volume-677b564c-9ff3-48e3-a65e-6809272908ce (677b564c-9ff3-48e3-a65e-6809272908ce): created successfully Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd1cf03-74ce-413d-bfc9-4b659c0404e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Flow 'volume_create_manager' (30ff9791-731f-4049-ab50-cbb9b3bdb6cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:26:19 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-5679719c-1a8b-48a1-b890-0a50a4910055 tempest-ProjectReaderTests-791416801 None] Created volume successfully. Jul 22 12:26:19 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e 1073741824" returned: 0 in 0.406s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:19 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e Jul 22 12:26:19 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:20 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e" returned: 0 in 0.258s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-077992a3-2bfb-4f2d-8242-78c63a1e3224 tempest-ProjectReaderTests-831764688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.730s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1062a2e2-82d4-4028-8776-01f6e7c9aae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac84f222-70fd-4675-b630-9bebcf68042e', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e88ea9a3-0ea8-4671-8a0f-71c35f1c6b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-077992a3-2bfb-4f2d-8242-78c63a1e3224 tempest-ProjectReaderTests-831764688 None] Creating offline snapshot 2651514f-8e02-4070-90ed-cba15c48713d of volume 94d665d4-1cb3-4705-996b-1e4b136f7dd0 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:26:20 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Volume volume-ac84f222-70fd-4675-b630-9bebcf68042e (ac84f222-70fd-4675-b630-9bebcf68042e): created successfully Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e88ea9a3-0ea8-4671-8a0f-71c35f1c6b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Flow 'volume_create_manager' (6fdcac67-3042-4ae8-a051-8717429d59fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b139af2-07f5-4311-9cad-d9d27227d54a]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-077992a3-2bfb-4f2d-8242-78c63a1e3224 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:20 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-fbaf0d1e-0016-421d-9367-d4f01bb3352f tempest-ProjectMemberTests-872887571 None] Created volume successfully. Jul 22 12:26:20 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0 Jul 22 12:26:20 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-cdcaa49b-1ac9-471f-84cf-42aa935feee5 tempest-ProjectReaderTests-791416801 None] Acquiring lock "cinder-677b564c-9ff3-48e3-a65e-6809272908ce-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-cdcaa49b-1ac9-471f-84cf-42aa935feee5 tempest-ProjectReaderTests-791416801 None] Lock "cinder-677b564c-9ff3-48e3-a65e-6809272908ce-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-cdcaa49b-1ac9-471f-84cf-42aa935feee5 tempest-ProjectReaderTests-791416801 None] Acquiring lock "cinder-quobyte-677b564c-9ff3-48e3-a65e-6809272908ce" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-cdcaa49b-1ac9-471f-84cf-42aa935feee5 tempest-ProjectReaderTests-791416801 None] Lock "cinder-quobyte-677b564c-9ff3-48e3-a65e-6809272908ce" acquired by "delete_volume" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d7891a-ebfc-4f32-9be6-55040682f1cc]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-cdcaa49b-1ac9-471f-84cf-42aa935feee5 tempest-ProjectReaderTests-791416801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-677b564c-9ff3-48e3-a65e-6809272908ce {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:20 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-077992a3-2bfb-4f2d-8242-78c63a1e3224 tempest-ProjectReaderTests-831764688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0" returned: 0 in 0.390s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-077992a3-2bfb-4f2d-8242-78c63a1e3224 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.2651514f-8e02-4070-90ed-cba15c48713d 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:20 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.2651514f-8e02-4070-90ed-cba15c48713d 1G Jul 22 12:26:20 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:20 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-677b564c-9ff3-48e3-a65e-6809272908ce Jul 22 12:26:20 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:20 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-cdcaa49b-1ac9-471f-84cf-42aa935feee5 tempest-ProjectReaderTests-791416801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-677b564c-9ff3-48e3-a65e-6809272908ce" returned: 0 in 0.362s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-cdcaa49b-1ac9-471f-84cf-42aa935feee5 tempest-ProjectReaderTests-791416801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-677b564c-9ff3-48e3-a65e-6809272908ce {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:20 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-677b564c-9ff3-48e3-a65e-6809272908ce Jul 22 12:26:20 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:20 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-077992a3-2bfb-4f2d-8242-78c63a1e3224 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.2651514f-8e02-4070-90ed-cba15c48713d 1G" returned: 0 in 0.406s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-077992a3-2bfb-4f2d-8242-78c63a1e3224 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.2651514f-8e02-4070-90ed-cba15c48713d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:20 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.2651514f-8e02-4070-90ed-cba15c48713d Jul 22 12:26:20 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:21 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-cdcaa49b-1ac9-471f-84cf-42aa935feee5 tempest-ProjectReaderTests-791416801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-677b564c-9ff3-48e3-a65e-6809272908ce" returned: 0 in 0.253s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:21 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-cdcaa49b-1ac9-471f-84cf-42aa935feee5 tempest-ProjectReaderTests-791416801 None] Lock "cinder-quobyte-677b564c-9ff3-48e3-a65e-6809272908ce" released by "delete_volume" :: held 0.663s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:21 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-cdcaa49b-1ac9-471f-84cf-42aa935feee5 tempest-ProjectReaderTests-791416801 None] Created reservations ['7df06284-ecde-4594-8d86-c6fbb3bc22a5', 'afee85e8-ac3e-4617-b15f-4862b24fada7', '5cfa5d3b-0355-44d5-974a-3e4316e2160b', '6a5c9f79-4cc7-4f82-9a7a-5c84800109b1'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-cdcaa49b-1ac9-471f-84cf-42aa935feee5 tempest-ProjectReaderTests-791416801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-cdcaa49b-1ac9-471f-84cf-42aa935feee5 tempest-ProjectReaderTests-791416801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-cdcaa49b-1ac9-471f-84cf-42aa935feee5 tempest-ProjectReaderTests-791416801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:21 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-cdcaa49b-1ac9-471f-84cf-42aa935feee5 tempest-ProjectReaderTests-791416801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-cdcaa49b-1ac9-471f-84cf-42aa935feee5 tempest-ProjectReaderTests-791416801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-cdcaa49b-1ac9-471f-84cf-42aa935feee5 tempest-ProjectReaderTests-791416801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:21 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-077992a3-2bfb-4f2d-8242-78c63a1e3224 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.2651514f-8e02-4070-90ed-cba15c48713d" returned: 0 in 0.361s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:21 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-077992a3-2bfb-4f2d-8242-78c63a1e3224 tempest-ProjectReaderTests-831764688 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.2651514f-8e02-4070-90ed-cba15c48713d is being set with open permissions: ugo+rw Jul 22 12:26:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-077992a3-2bfb-4f2d-8242-78c63a1e3224 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.2651514f-8e02-4070-90ed-cba15c48713d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:21 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:26:21 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:21 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.2651514f-8e02-4070-90ed-cba15c48713d Jul 22 12:26:21 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aca3ae6b-caef-47ac-a258-f3e1fbf31fb4 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:21 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-cdcaa49b-1ac9-471f-84cf-42aa935feee5 tempest-ProjectReaderTests-791416801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.268s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:21 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-cdcaa49b-1ac9-471f-84cf-42aa935feee5 tempest-ProjectReaderTests-791416801 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:26:21 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-cdcaa49b-1ac9-471f-84cf-42aa935feee5 tempest-ProjectReaderTests-791416801 None] Deleted volume successfully. Jul 22 12:26:21 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-077992a3-2bfb-4f2d-8242-78c63a1e3224 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.2651514f-8e02-4070-90ed-cba15c48713d" returned: 0 in 0.277s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:21 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-cdcaa49b-1ac9-471f-84cf-42aa935feee5 tempest-ProjectReaderTests-791416801 None] Lock "cinder-677b564c-9ff3-48e3-a65e-6809272908ce-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-077992a3-2bfb-4f2d-8242-78c63a1e3224 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:21 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.info Jul 22 12:26:21 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:21 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-077992a3-2bfb-4f2d-8242-78c63a1e3224 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.info" returned: 0 in 0.272s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:21 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-077992a3-2bfb-4f2d-8242-78c63a1e3224 tempest-ProjectReaderTests-831764688 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.info is being set with open permissions: ugo+rw Jul 22 12:26:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-077992a3-2bfb-4f2d-8242-78c63a1e3224 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:21 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.info Jul 22 12:26:21 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:22 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-077992a3-2bfb-4f2d-8242-78c63a1e3224 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.info" returned: 0 in 0.258s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-077992a3-2bfb-4f2d-8242-78c63a1e3224 tempest-ProjectReaderTests-831764688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.077s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aca3ae6b-caef-47ac-a258-f3e1fbf31fb4 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.779s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-aca3ae6b-caef-47ac-a258-f3e1fbf31fb4 tempest-ProjectMemberTests-872887571 None] Creating offline snapshot 64b9472e-8b1f-4ed0-a08d-c85c2c84a98f of volume ac84f222-70fd-4675-b630-9bebcf68042e {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:26:22 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-077992a3-2bfb-4f2d-8242-78c63a1e3224 tempest-ProjectReaderTests-831764688 None] Create snapshot completed successfully Jul 22 12:26:22 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1b3692-8d7b-4d5b-8c59-e293ac1a6d03]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aca3ae6b-caef-47ac-a258-f3e1fbf31fb4 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:22 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e Jul 22 12:26:22 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-de55a96d-21a1-487c-8616-3e00405af5c6 tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-2651514f-8e02-4070-90ed-cba15c48713d-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-de55a96d-21a1-487c-8616-3e00405af5c6 tempest-ProjectReaderTests-831764688 None] Lock "cinder-2651514f-8e02-4070-90ed-cba15c48713d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-de55a96d-21a1-487c-8616-3e00405af5c6 tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-quobyte-94d665d4-1cb3-4705-996b-1e4b136f7dd0" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-de55a96d-21a1-487c-8616-3e00405af5c6 tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-94d665d4-1cb3-4705-996b-1e4b136f7dd0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-de55a96d-21a1-487c-8616-3e00405af5c6 tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-quobyte-2651514f-8e02-4070-90ed-cba15c48713d" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:22 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aca3ae6b-caef-47ac-a258-f3e1fbf31fb4 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e" returned: 0 in 0.417s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aca3ae6b-caef-47ac-a258-f3e1fbf31fb4 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.64b9472e-8b1f-4ed0-a08d-c85c2c84a98f 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-de55a96d-21a1-487c-8616-3e00405af5c6 tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-2651514f-8e02-4070-90ed-cba15c48713d" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-de55a96d-21a1-487c-8616-3e00405af5c6 tempest-ProjectReaderTests-831764688 None] Deleting offline snapshot 2651514f-8e02-4070-90ed-cba15c48713d of volume 94d665d4-1cb3-4705-996b-1e4b136f7dd0 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:26:22 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.64b9472e-8b1f-4ed0-a08d-c85c2c84a98f 1G Jul 22 12:26:22 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-de55a96d-21a1-487c-8616-3e00405af5c6 tempest-ProjectReaderTests-831764688 None] snapshot_file for this snap is: volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.2651514f-8e02-4070-90ed-cba15c48713d {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:26:22 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7fd617-5c06-476b-b778-43314838d819]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-de55a96d-21a1-487c-8616-3e00405af5c6 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.2651514f-8e02-4070-90ed-cba15c48713d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:22 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.2651514f-8e02-4070-90ed-cba15c48713d Jul 22 12:26:22 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:23 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aca3ae6b-caef-47ac-a258-f3e1fbf31fb4 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.64b9472e-8b1f-4ed0-a08d-c85c2c84a98f 1G" returned: 0 in 0.468s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aca3ae6b-caef-47ac-a258-f3e1fbf31fb4 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac84f222-70fd-4675-b630-9bebcf68042e -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.64b9472e-8b1f-4ed0-a08d-c85c2c84a98f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:23 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-de55a96d-21a1-487c-8616-3e00405af5c6 tempest-ProjectReaderTests-831764688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.2651514f-8e02-4070-90ed-cba15c48713d" returned: 0 in 0.419s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-de55a96d-21a1-487c-8616-3e00405af5c6 tempest-ProjectReaderTests-831764688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:26:23 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac84f222-70fd-4675-b630-9bebcf68042e -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.64b9472e-8b1f-4ed0-a08d-c85c2c84a98f Jul 22 12:26:23 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:23 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[8196a266-3710-4817-8363-5fc1d1472c8d]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-de55a96d-21a1-487c-8616-3e00405af5c6 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:23 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0 Jul 22 12:26:23 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:23 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aca3ae6b-caef-47ac-a258-f3e1fbf31fb4 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac84f222-70fd-4675-b630-9bebcf68042e -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.64b9472e-8b1f-4ed0-a08d-c85c2c84a98f" returned: 0 in 0.331s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:23 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-aca3ae6b-caef-47ac-a258-f3e1fbf31fb4 tempest-ProjectMemberTests-872887571 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.64b9472e-8b1f-4ed0-a08d-c85c2c84a98f is being set with open permissions: ugo+rw Jul 22 12:26:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aca3ae6b-caef-47ac-a258-f3e1fbf31fb4 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.64b9472e-8b1f-4ed0-a08d-c85c2c84a98f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:23 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.64b9472e-8b1f-4ed0-a08d-c85c2c84a98f Jul 22 12:26:23 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:23 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-de55a96d-21a1-487c-8616-3e00405af5c6 tempest-ProjectReaderTests-831764688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0" returned: 0 in 0.430s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-de55a96d-21a1-487c-8616-3e00405af5c6 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.2651514f-8e02-4070-90ed-cba15c48713d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:23 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.2651514f-8e02-4070-90ed-cba15c48713d Jul 22 12:26:23 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:23 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aca3ae6b-caef-47ac-a258-f3e1fbf31fb4 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.64b9472e-8b1f-4ed0-a08d-c85c2c84a98f" returned: 0 in 0.278s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aca3ae6b-caef-47ac-a258-f3e1fbf31fb4 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:23 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.info Jul 22 12:26:23 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:23 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-de55a96d-21a1-487c-8616-3e00405af5c6 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.2651514f-8e02-4070-90ed-cba15c48713d" returned: 0 in 0.368s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-de55a96d-21a1-487c-8616-3e00405af5c6 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.2651514f-8e02-4070-90ed-cba15c48713d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:23 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.2651514f-8e02-4070-90ed-cba15c48713d Jul 22 12:26:23 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:23 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aca3ae6b-caef-47ac-a258-f3e1fbf31fb4 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.info" returned: 0 in 0.273s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:23 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-aca3ae6b-caef-47ac-a258-f3e1fbf31fb4 tempest-ProjectMemberTests-872887571 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.info is being set with open permissions: ugo+rw Jul 22 12:26:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aca3ae6b-caef-47ac-a258-f3e1fbf31fb4 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:23 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.info Jul 22 12:26:23 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:24 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-de55a96d-21a1-487c-8616-3e00405af5c6 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0.2651514f-8e02-4070-90ed-cba15c48713d" returned: 0 in 0.292s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:24 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-aca3ae6b-caef-47ac-a258-f3e1fbf31fb4 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.info" returned: 0 in 0.278s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-aca3ae6b-caef-47ac-a258-f3e1fbf31fb4 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.151s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-de55a96d-21a1-487c-8616-3e00405af5c6 tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-2651514f-8e02-4070-90ed-cba15c48713d" released by "_delete_snapshot" :: held 1.671s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-de55a96d-21a1-487c-8616-3e00405af5c6 tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-94d665d4-1cb3-4705-996b-1e4b136f7dd0" released by "delete_snapshot" :: held 1.713s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:24 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-aca3ae6b-caef-47ac-a258-f3e1fbf31fb4 tempest-ProjectMemberTests-872887571 None] Create snapshot completed successfully Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-de55a96d-21a1-487c-8616-3e00405af5c6 tempest-ProjectReaderTests-831764688 None] Created reservations ['cad1f55f-e971-4d4f-aa74-3bc079c6ad4a', 'a6e46b06-9b39-4716-a0ca-8781996ea18a', '7093184e-a7dd-4704-abb1-293427415a1f', '0ed629a7-6c09-46f0-9cb8-5789c6d0dc95'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:24 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:26:24 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:24 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-de55a96d-21a1-487c-8616-3e00405af5c6 tempest-ProjectReaderTests-831764688 None] Delete snapshot completed successfully. Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-de55a96d-21a1-487c-8616-3e00405af5c6 tempest-ProjectReaderTests-831764688 None] Lock "cinder-2651514f-8e02-4070-90ed-cba15c48713d-delete_snapshot" released by "delete_snapshot" :: held 1.993s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-13d93922-373e-415a-963d-4d9af9606af1 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-64b9472e-8b1f-4ed0-a08d-c85c2c84a98f-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-13d93922-373e-415a-963d-4d9af9606af1 tempest-ProjectMemberTests-872887571 None] Lock "cinder-64b9472e-8b1f-4ed0-a08d-c85c2c84a98f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-13d93922-373e-415a-963d-4d9af9606af1 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-ac84f222-70fd-4675-b630-9bebcf68042e" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-13d93922-373e-415a-963d-4d9af9606af1 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-ac84f222-70fd-4675-b630-9bebcf68042e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-13d93922-373e-415a-963d-4d9af9606af1 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-64b9472e-8b1f-4ed0-a08d-c85c2c84a98f" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-13d93922-373e-415a-963d-4d9af9606af1 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-64b9472e-8b1f-4ed0-a08d-c85c2c84a98f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-13d93922-373e-415a-963d-4d9af9606af1 tempest-ProjectMemberTests-872887571 None] Deleting offline snapshot 64b9472e-8b1f-4ed0-a08d-c85c2c84a98f of volume ac84f222-70fd-4675-b630-9bebcf68042e {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-13d93922-373e-415a-963d-4d9af9606af1 tempest-ProjectMemberTests-872887571 None] snapshot_file for this snap is: volume-ac84f222-70fd-4675-b630-9bebcf68042e.64b9472e-8b1f-4ed0-a08d-c85c2c84a98f {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b503b1-e18b-41d8-b259-c0ee1d93db0e]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13d93922-373e-415a-963d-4d9af9606af1 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.64b9472e-8b1f-4ed0-a08d-c85c2c84a98f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-547232ab-2e88-4f46-bb68-205a3cedccd5 tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-94d665d4-1cb3-4705-996b-1e4b136f7dd0-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-547232ab-2e88-4f46-bb68-205a3cedccd5 tempest-ProjectReaderTests-831764688 None] Lock "cinder-94d665d4-1cb3-4705-996b-1e4b136f7dd0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:24 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.338s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread count: 28 {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread info: [<_MainThread(MainThread, started 137793405739136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-547232ab-2e88-4f46-bb68-205a3cedccd5 tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-quobyte-94d665d4-1cb3-4705-996b-1e4b136f7dd0" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-547232ab-2e88-4f46-bb68-205a3cedccd5 tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-94d665d4-1cb3-4705-996b-1e4b136f7dd0" acquired by "delete_volume" :: waited 0.015s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:24 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.64b9472e-8b1f-4ed0-a08d-c85c2c84a98f Jul 22 12:26:24 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5135f9-b5f6-49e7-8a0f-a2b8c4bfc23a]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-547232ab-2e88-4f46-bb68-205a3cedccd5 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:24 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0 Jul 22 12:26:25 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:25 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13d93922-373e-415a-963d-4d9af9606af1 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.64b9472e-8b1f-4ed0-a08d-c85c2c84a98f" returned: 0 in 0.443s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-13d93922-373e-415a-963d-4d9af9606af1 tempest-ProjectMemberTests-872887571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac84f222-70fd-4675-b630-9bebcf68042e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:26:25 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b679be8-218e-413a-b749-54020acace67]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13d93922-373e-415a-963d-4d9af9606af1 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:25 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e Jul 22 12:26:25 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:25 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-547232ab-2e88-4f46-bb68-205a3cedccd5 tempest-ProjectReaderTests-831764688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0" returned: 0 in 0.403s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-547232ab-2e88-4f46-bb68-205a3cedccd5 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:25 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0 Jul 22 12:26:25 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:25 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-547232ab-2e88-4f46-bb68-205a3cedccd5 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-94d665d4-1cb3-4705-996b-1e4b136f7dd0" returned: 0 in 0.286s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:25 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13d93922-373e-415a-963d-4d9af9606af1 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e" returned: 0 in 0.448s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13d93922-373e-415a-963d-4d9af9606af1 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.64b9472e-8b1f-4ed0-a08d-c85c2c84a98f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:25 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-547232ab-2e88-4f46-bb68-205a3cedccd5 tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-94d665d4-1cb3-4705-996b-1e4b136f7dd0" released by "delete_volume" :: held 0.775s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:25 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.64b9472e-8b1f-4ed0-a08d-c85c2c84a98f Jul 22 12:26:25 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:25 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-547232ab-2e88-4f46-bb68-205a3cedccd5 tempest-ProjectReaderTests-831764688 None] Created reservations ['604e007d-f27d-4193-b5c0-f9e3058227bc', '1d5227aa-3616-4b3f-8b1b-b0390d25aa55', '4b6dc7ef-763e-410b-b0b7-6197e6567169', 'bdf22099-900a-42ee-ad4a-e6f0972b1d86'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-547232ab-2e88-4f46-bb68-205a3cedccd5 tempest-ProjectReaderTests-831764688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-547232ab-2e88-4f46-bb68-205a3cedccd5 tempest-ProjectReaderTests-831764688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-547232ab-2e88-4f46-bb68-205a3cedccd5 tempest-ProjectReaderTests-831764688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:25 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-547232ab-2e88-4f46-bb68-205a3cedccd5 tempest-ProjectReaderTests-831764688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-547232ab-2e88-4f46-bb68-205a3cedccd5 tempest-ProjectReaderTests-831764688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:25 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-547232ab-2e88-4f46-bb68-205a3cedccd5 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:25 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:26:25 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:26 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13d93922-373e-415a-963d-4d9af9606af1 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.64b9472e-8b1f-4ed0-a08d-c85c2c84a98f" returned: 0 in 0.583s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13d93922-373e-415a-963d-4d9af9606af1 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.64b9472e-8b1f-4ed0-a08d-c85c2c84a98f {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:26 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-547232ab-2e88-4f46-bb68-205a3cedccd5 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.380s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-547232ab-2e88-4f46-bb68-205a3cedccd5 tempest-ProjectReaderTests-831764688 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:26:26 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.64b9472e-8b1f-4ed0-a08d-c85c2c84a98f Jul 22 12:26:26 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:26 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-547232ab-2e88-4f46-bb68-205a3cedccd5 tempest-ProjectReaderTests-831764688 None] Deleted volume successfully. Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-547232ab-2e88-4f46-bb68-205a3cedccd5 tempest-ProjectReaderTests-831764688 None] Lock "cinder-94d665d4-1cb3-4705-996b-1e4b136f7dd0-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:26 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-13d93922-373e-415a-963d-4d9af9606af1 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e.64b9472e-8b1f-4ed0-a08d-c85c2c84a98f" returned: 0 in 0.331s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-13d93922-373e-415a-963d-4d9af9606af1 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-64b9472e-8b1f-4ed0-a08d-c85c2c84a98f" released by "_delete_snapshot" :: held 1.910s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-13d93922-373e-415a-963d-4d9af9606af1 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-ac84f222-70fd-4675-b630-9bebcf68042e" released by "delete_snapshot" :: held 1.940s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-13d93922-373e-415a-963d-4d9af9606af1 tempest-ProjectMemberTests-872887571 None] Created reservations ['9cfa0b20-c511-49a5-ba65-1ba49129d1be', 'c124f048-5d1a-464d-a232-a4b927dc75f3', 'c85ac890-ed45-439f-b158-75489b02fd38', '726b081b-0875-4e87-8089-c13fab34e3ff'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Flow 'volume_create_manager' (ce98f118-5313-475d-bffb-1297252d6d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aedd0fe9-f6db-4abd-8144-1ae90b2c112b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aedd0fe9-f6db-4abd-8144-1ae90b2c112b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698666459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d31720e-fee9-4bc4-a7c7-718ce2d86d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f63399c06fe47509996d028e2e02634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:26:27Z,use_quota=True,user_id='bbe9dbd345eb4efc802016ed89e01d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb1196d-cb0b-4300-ad31-f028b5c08ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb1196d-cb0b-4300-ad31-f028b5c08ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1037f532-e4fb-4790-96ef-bbac46e41677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1037f532-e4fb-4790-96ef-bbac46e41677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d31720e-fee9-4bc4-a7c7-718ce2d86d0d', 'volume_name': 'volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b5a623-2abc-4713-81fe-e5f8b761de0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b5a623-2abc-4713-81fe-e5f8b761de0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5dd57bc-bd7d-4958-b6fc-33ef96fe4d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:26 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Volume 2d31720e-fee9-4bc4-a7c7-718ce2d86d0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d', 'volume_size': 1} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698666459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d31720e-fee9-4bc4-a7c7-718ce2d86d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f63399c06fe47509996d028e2e02634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:26:27Z,use_quota=True,user_id='bbe9dbd345eb4efc802016ed89e01d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Creating volume 2d31720e-fee9-4bc4-a7c7-718ce2d86d0d {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:26:26 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:26 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d 1073741824 Jul 22 12:26:26 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:26 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-13d93922-373e-415a-963d-4d9af9606af1 tempest-ProjectMemberTests-872887571 None] Delete snapshot completed successfully. Jul 22 12:26:26 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-13d93922-373e-415a-963d-4d9af9606af1 tempest-ProjectMemberTests-872887571 None] Lock "cinder-64b9472e-8b1f-4ed0-a08d-c85c2c84a98f-delete_snapshot" released by "delete_snapshot" :: held 2.229s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:27 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d 1073741824" returned: 0 in 0.466s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:27 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d Jul 22 12:26:27 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:27 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d" returned: 0 in 0.257s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:27 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:26:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5dd57bc-bd7d-4958-b6fc-33ef96fe4d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61dad739-d1ed-45d9-8e19-44a0a8fecbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:27 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Volume volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d (2d31720e-fee9-4bc4-a7c7-718ce2d86d0d): created successfully Jul 22 12:26:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61dad739-d1ed-45d9-8e19-44a0a8fecbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:27 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Flow 'volume_create_manager' (ce98f118-5313-475d-bffb-1297252d6d83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:26:27 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-7be04832-004d-446b-a7e8-6ead03012858 tempest-ProjectReaderTests-831764688 None] Created volume successfully. Jul 22 12:26:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ce6fb7f0-6a39-4c63-b95d-64c69fb4670d tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-ac84f222-70fd-4675-b630-9bebcf68042e-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ce6fb7f0-6a39-4c63-b95d-64c69fb4670d tempest-ProjectMemberTests-872887571 None] Lock "cinder-ac84f222-70fd-4675-b630-9bebcf68042e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ce6fb7f0-6a39-4c63-b95d-64c69fb4670d tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-ac84f222-70fd-4675-b630-9bebcf68042e" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:27 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ce6fb7f0-6a39-4c63-b95d-64c69fb4670d tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-ac84f222-70fd-4675-b630-9bebcf68042e" acquired by "delete_volume" :: waited 0.022s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:27 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7d0d88-f7ed-45c9-9f59-94e170d34bb2]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:27 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ce6fb7f0-6a39-4c63-b95d-64c69fb4670d tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:28 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e Jul 22 12:26:28 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:28 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ce6fb7f0-6a39-4c63-b95d-64c69fb4670d tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e" returned: 0 in 0.409s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ce6fb7f0-6a39-4c63-b95d-64c69fb4670d tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:28 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e Jul 22 12:26:28 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:28 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ce6fb7f0-6a39-4c63-b95d-64c69fb4670d tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ac84f222-70fd-4675-b630-9bebcf68042e" returned: 0 in 0.247s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:28 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ce6fb7f0-6a39-4c63-b95d-64c69fb4670d tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-ac84f222-70fd-4675-b630-9bebcf68042e" released by "delete_volume" :: held 0.727s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:28 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-ce6fb7f0-6a39-4c63-b95d-64c69fb4670d tempest-ProjectMemberTests-872887571 None] Created reservations ['e0bece88-694f-4f9f-80f9-6c0d84696959', '0cf5436d-4427-4cfe-9adf-58635918774a', '2c72a36c-25ef-4363-a72c-f07a2221fcf7', '5989752c-ec22-4b45-8b39-293eb2622cab'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ce6fb7f0-6a39-4c63-b95d-64c69fb4670d tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ce6fb7f0-6a39-4c63-b95d-64c69fb4670d tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ce6fb7f0-6a39-4c63-b95d-64c69fb4670d tempest-ProjectMemberTests-872887571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ce6fb7f0-6a39-4c63-b95d-64c69fb4670d tempest-ProjectMemberTests-872887571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ce6fb7f0-6a39-4c63-b95d-64c69fb4670d tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ce6fb7f0-6a39-4c63-b95d-64c69fb4670d tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:28 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:26:28 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bede1924-fac2-4eb9-8c9d-39403dfcb087 tempest-ProjectReaderTests-831764688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bede1924-fac2-4eb9-8c9d-39403dfcb087 tempest-ProjectReaderTests-831764688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:28 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-bede1924-fac2-4eb9-8c9d-39403dfcb087 tempest-ProjectReaderTests-831764688 None] Creating offline snapshot 982520d6-0e23-405e-a67f-ff61b0d6b5d6 of volume 2d31720e-fee9-4bc4-a7c7-718ce2d86d0d {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:26:28 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[859d8857-2877-479a-a380-379d9ed05320]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:28 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bede1924-fac2-4eb9-8c9d-39403dfcb087 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:29 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ce6fb7f0-6a39-4c63-b95d-64c69fb4670d tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.267s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:29 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-ce6fb7f0-6a39-4c63-b95d-64c69fb4670d tempest-ProjectMemberTests-872887571 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:26:29 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-ce6fb7f0-6a39-4c63-b95d-64c69fb4670d tempest-ProjectMemberTests-872887571 None] Deleted volume successfully. Jul 22 12:26:29 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ce6fb7f0-6a39-4c63-b95d-64c69fb4670d tempest-ProjectMemberTests-872887571 None] Lock "cinder-ac84f222-70fd-4675-b630-9bebcf68042e-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:29 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d Jul 22 12:26:29 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:29 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bede1924-fac2-4eb9-8c9d-39403dfcb087 tempest-ProjectReaderTests-831764688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d" returned: 0 in 0.417s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bede1924-fac2-4eb9-8c9d-39403dfcb087 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.982520d6-0e23-405e-a67f-ff61b0d6b5d6 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:29 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.982520d6-0e23-405e-a67f-ff61b0d6b5d6 1G Jul 22 12:26:29 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:29 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:26:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Flow 'volume_create_manager' (41e7254e-40f1-46c8-8180-38aea8635404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:26:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065858a9-f3f5-4432-bb62-5e933f325b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065858a9-f3f5-4432-bb62-5e933f325b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575918875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89707e5757184c76b39c42c3553f59c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:26:29Z,use_quota=True,user_id='edd7857f9fd44201b44894c8b9b98d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9621fc6b-fabe-4124-b2c2-b4ccaa392367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9621fc6b-fabe-4124-b2c2-b4ccaa392367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb68881d-d19d-4dcf-ae18-ece17dba866c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb68881d-d19d-4dcf-ae18-ece17dba866c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0', 'volume_name': 'volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c09149d-37c2-4689-8b4d-110611ba517d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c09149d-37c2-4689-8b4d-110611ba517d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:29 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c9ab81-1a22-4426-b39c-3c7165293349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:29 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Volume 42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0', 'volume_size': 1} Jul 22 12:26:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:29 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bede1924-fac2-4eb9-8c9d-39403dfcb087 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.982520d6-0e23-405e-a67f-ff61b0d6b5d6 1G" returned: 0 in 0.389s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:29 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bede1924-fac2-4eb9-8c9d-39403dfcb087 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.982520d6-0e23-405e-a67f-ff61b0d6b5d6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:29 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.982520d6-0e23-405e-a67f-ff61b0d6b5d6 Jul 22 12:26:29 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:30 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bede1924-fac2-4eb9-8c9d-39403dfcb087 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.982520d6-0e23-405e-a67f-ff61b0d6b5d6" returned: 0 in 0.286s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:30 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-bede1924-fac2-4eb9-8c9d-39403dfcb087 tempest-ProjectReaderTests-831764688 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.982520d6-0e23-405e-a67f-ff61b0d6b5d6 is being set with open permissions: ugo+rw Jul 22 12:26:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bede1924-fac2-4eb9-8c9d-39403dfcb087 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.982520d6-0e23-405e-a67f-ff61b0d6b5d6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:30 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.982520d6-0e23-405e-a67f-ff61b0d6b5d6 Jul 22 12:26:30 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:30 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bede1924-fac2-4eb9-8c9d-39403dfcb087 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.982520d6-0e23-405e-a67f-ff61b0d6b5d6" returned: 0 in 0.237s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bede1924-fac2-4eb9-8c9d-39403dfcb087 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:30 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.info Jul 22 12:26:30 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:30 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bede1924-fac2-4eb9-8c9d-39403dfcb087 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.info" returned: 0 in 0.253s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:30 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-bede1924-fac2-4eb9-8c9d-39403dfcb087 tempest-ProjectReaderTests-831764688 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.info is being set with open permissions: ugo+rw Jul 22 12:26:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bede1924-fac2-4eb9-8c9d-39403dfcb087 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:30 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.info Jul 22 12:26:30 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:30 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bede1924-fac2-4eb9-8c9d-39403dfcb087 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.info" returned: 0 in 0.243s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-bede1924-fac2-4eb9-8c9d-39403dfcb087 tempest-ProjectReaderTests-831764688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.910s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.273s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575918875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89707e5757184c76b39c42c3553f59c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:26:29Z,use_quota=True,user_id='edd7857f9fd44201b44894c8b9b98d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:26:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Creating volume 42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:26:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:30 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:26:30 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:26:30 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:30 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0 1073741824 Jul 22 12:26:30 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:30 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-bede1924-fac2-4eb9-8c9d-39403dfcb087 tempest-ProjectReaderTests-831764688 None] Create snapshot completed successfully Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bccf4971-b0cf-461c-b0ae-49326e504d02 tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-982520d6-0e23-405e-a67f-ff61b0d6b5d6-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bccf4971-b0cf-461c-b0ae-49326e504d02 tempest-ProjectReaderTests-831764688 None] Lock "cinder-982520d6-0e23-405e-a67f-ff61b0d6b5d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bccf4971-b0cf-461c-b0ae-49326e504d02 tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-quobyte-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bccf4971-b0cf-461c-b0ae-49326e504d02 tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bccf4971-b0cf-461c-b0ae-49326e504d02 tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-quobyte-982520d6-0e23-405e-a67f-ff61b0d6b5d6" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bccf4971-b0cf-461c-b0ae-49326e504d02 tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-982520d6-0e23-405e-a67f-ff61b0d6b5d6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-bccf4971-b0cf-461c-b0ae-49326e504d02 tempest-ProjectReaderTests-831764688 None] Deleting offline snapshot 982520d6-0e23-405e-a67f-ff61b0d6b5d6 of volume 2d31720e-fee9-4bc4-a7c7-718ce2d86d0d {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-bccf4971-b0cf-461c-b0ae-49326e504d02 tempest-ProjectReaderTests-831764688 None] snapshot_file for this snap is: volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.982520d6-0e23-405e-a67f-ff61b0d6b5d6 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bcb4e0-ba7f-4a64-845d-6d41590d908f]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bccf4971-b0cf-461c-b0ae-49326e504d02 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.982520d6-0e23-405e-a67f-ff61b0d6b5d6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:31 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.982520d6-0e23-405e-a67f-ff61b0d6b5d6 Jul 22 12:26:31 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:31 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0 1073741824" returned: 0 in 0.454s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:31 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0 Jul 22 12:26:31 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:31 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bccf4971-b0cf-461c-b0ae-49326e504d02 tempest-ProjectReaderTests-831764688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.982520d6-0e23-405e-a67f-ff61b0d6b5d6" returned: 0 in 0.374s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-bccf4971-b0cf-461c-b0ae-49326e504d02 tempest-ProjectReaderTests-831764688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a06af1-e4d6-48ca-a89e-10fbc3e8a55a]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bccf4971-b0cf-461c-b0ae-49326e504d02 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:31 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0" returned: 0 in 0.257s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c9ab81-1a22-4426-b39c-3c7165293349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678498e8-087a-4144-b5ac-80a9904e0efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:31 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Volume volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0 (42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0): created successfully Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678498e8-087a-4144-b5ac-80a9904e0efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Flow 'volume_create_manager' (41e7254e-40f1-46c8-8180-38aea8635404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:26:31 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-9fe793c9-cec7-41a0-ad29-03f5e0964ac4 tempest-ProjectMemberTests-872887571 None] Created volume successfully. Jul 22 12:26:31 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d Jul 22 12:26:31 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:31 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bccf4971-b0cf-461c-b0ae-49326e504d02 tempest-ProjectReaderTests-831764688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d" returned: 0 in 0.372s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:31 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bccf4971-b0cf-461c-b0ae-49326e504d02 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.982520d6-0e23-405e-a67f-ff61b0d6b5d6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:31 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.982520d6-0e23-405e-a67f-ff61b0d6b5d6 Jul 22 12:26:31 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:32 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bccf4971-b0cf-461c-b0ae-49326e504d02 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.982520d6-0e23-405e-a67f-ff61b0d6b5d6" returned: 0 in 0.342s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bccf4971-b0cf-461c-b0ae-49326e504d02 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.982520d6-0e23-405e-a67f-ff61b0d6b5d6 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:32 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.982520d6-0e23-405e-a67f-ff61b0d6b5d6 Jul 22 12:26:32 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:32 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-bccf4971-b0cf-461c-b0ae-49326e504d02 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d.982520d6-0e23-405e-a67f-ff61b0d6b5d6" returned: 0 in 0.251s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bccf4971-b0cf-461c-b0ae-49326e504d02 tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-982520d6-0e23-405e-a67f-ff61b0d6b5d6" released by "_delete_snapshot" :: held 1.442s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bccf4971-b0cf-461c-b0ae-49326e504d02 tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d" released by "delete_snapshot" :: held 1.468s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:32 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-bccf4971-b0cf-461c-b0ae-49326e504d02 tempest-ProjectReaderTests-831764688 None] Created reservations ['2c4f2bf1-d71f-422b-8120-2aa85b3c3035', '96e6c35a-f3b5-42f3-9c9f-fdb0cbea8c0e', '86c184d7-71b5-48fa-9033-ad1c82b7ebf1', '96566295-922c-4832-9082-c205569dd18c'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:32 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-bccf4971-b0cf-461c-b0ae-49326e504d02 tempest-ProjectReaderTests-831764688 None] Delete snapshot completed successfully. Jul 22 12:26:32 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-bccf4971-b0cf-461c-b0ae-49326e504d02 tempest-ProjectReaderTests-831764688 None] Lock "cinder-982520d6-0e23-405e-a67f-ff61b0d6b5d6-delete_snapshot" released by "delete_snapshot" :: held 1.617s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0c68963c-e8e8-4492-bb20-f090c31d952f tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0c68963c-e8e8-4492-bb20-f090c31d952f tempest-ProjectMemberTests-872887571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:32 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-0c68963c-e8e8-4492-bb20-f090c31d952f tempest-ProjectMemberTests-872887571 None] Creating offline snapshot e0d07094-d5c3-4390-828a-492226a56742 of volume 42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:26:32 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c4c7d6-338f-4487-a33c-671ef81209af]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:32 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0c68963c-e8e8-4492-bb20-f090c31d952f tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:32 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0 Jul 22 12:26:32 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:33 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0c68963c-e8e8-4492-bb20-f090c31d952f tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0" returned: 0 in 0.368s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0c68963c-e8e8-4492-bb20-f090c31d952f tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.e0d07094-d5c3-4390-828a-492226a56742 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:33 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.e0d07094-d5c3-4390-828a-492226a56742 1G Jul 22 12:26:33 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d54ce7af-26bc-4833-8f64-d2f59085042a tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d54ce7af-26bc-4833-8f64-d2f59085042a tempest-ProjectReaderTests-831764688 None] Lock "cinder-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d54ce7af-26bc-4833-8f64-d2f59085042a tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-quobyte-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d54ce7af-26bc-4833-8f64-d2f59085042a tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d" acquired by "delete_volume" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:33 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[4007789c-5c13-490f-a693-b537996acb1a]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d54ce7af-26bc-4833-8f64-d2f59085042a tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:33 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d Jul 22 12:26:33 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:33 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0c68963c-e8e8-4492-bb20-f090c31d952f tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.e0d07094-d5c3-4390-828a-492226a56742 1G" returned: 0 in 0.397s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0c68963c-e8e8-4492-bb20-f090c31d952f tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.e0d07094-d5c3-4390-828a-492226a56742 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:33 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.e0d07094-d5c3-4390-828a-492226a56742 Jul 22 12:26:33 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:33 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d54ce7af-26bc-4833-8f64-d2f59085042a tempest-ProjectReaderTests-831764688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d" returned: 0 in 0.381s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d54ce7af-26bc-4833-8f64-d2f59085042a tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:33 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d Jul 22 12:26:33 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:33 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0c68963c-e8e8-4492-bb20-f090c31d952f tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.e0d07094-d5c3-4390-828a-492226a56742" returned: 0 in 0.301s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:33 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-0c68963c-e8e8-4492-bb20-f090c31d952f tempest-ProjectMemberTests-872887571 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.e0d07094-d5c3-4390-828a-492226a56742 is being set with open permissions: ugo+rw Jul 22 12:26:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0c68963c-e8e8-4492-bb20-f090c31d952f tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.e0d07094-d5c3-4390-828a-492226a56742 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:33 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.e0d07094-d5c3-4390-828a-492226a56742 Jul 22 12:26:33 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:33 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:33 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d54ce7af-26bc-4833-8f64-d2f59085042a tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d" returned: 0 in 0.252s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:33 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d54ce7af-26bc-4833-8f64-d2f59085042a tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d" released by "delete_volume" :: held 0.691s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-d54ce7af-26bc-4833-8f64-d2f59085042a tempest-ProjectReaderTests-831764688 None] Created reservations ['c54b3404-8564-4300-bd38-1e2b1d5537ea', '4fe79157-c5e3-474a-8560-f62e791711bb', 'a51d7ee0-6ad0-4605-947a-6458407c7058', 'b6941772-ca1a-444f-939b-4fc1dbcc7372'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d54ce7af-26bc-4833-8f64-d2f59085042a tempest-ProjectReaderTests-831764688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d54ce7af-26bc-4833-8f64-d2f59085042a tempest-ProjectReaderTests-831764688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d54ce7af-26bc-4833-8f64-d2f59085042a tempest-ProjectReaderTests-831764688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d54ce7af-26bc-4833-8f64-d2f59085042a tempest-ProjectReaderTests-831764688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d54ce7af-26bc-4833-8f64-d2f59085042a tempest-ProjectReaderTests-831764688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d54ce7af-26bc-4833-8f64-d2f59085042a tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:34 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0c68963c-e8e8-4492-bb20-f090c31d952f tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.e0d07094-d5c3-4390-828a-492226a56742" returned: 0 in 0.264s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:34 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:26:34 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0c68963c-e8e8-4492-bb20-f090c31d952f tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:34 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.info Jul 22 12:26:34 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:34 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d54ce7af-26bc-4833-8f64-d2f59085042a tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.255s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-d54ce7af-26bc-4833-8f64-d2f59085042a tempest-ProjectReaderTests-831764688 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:26:34 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d54ce7af-26bc-4833-8f64-d2f59085042a tempest-ProjectReaderTests-831764688 None] Deleted volume successfully. Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-d54ce7af-26bc-4833-8f64-d2f59085042a tempest-ProjectReaderTests-831764688 None] Lock "cinder-2d31720e-fee9-4bc4-a7c7-718ce2d86d0d-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:34 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0c68963c-e8e8-4492-bb20-f090c31d952f tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.info" returned: 0 in 0.279s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:34 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-0c68963c-e8e8-4492-bb20-f090c31d952f tempest-ProjectMemberTests-872887571 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.info is being set with open permissions: ugo+rw Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0c68963c-e8e8-4492-bb20-f090c31d952f tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:34 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.info Jul 22 12:26:34 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:34 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0c68963c-e8e8-4492-bb20-f090c31d952f tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.info" returned: 0 in 0.262s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0c68963c-e8e8-4492-bb20-f090c31d952f tempest-ProjectMemberTests-872887571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.949s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:34 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-0c68963c-e8e8-4492-bb20-f090c31d952f tempest-ProjectMemberTests-872887571 None] Create snapshot completed successfully Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Flow 'volume_create_manager' (774011ff-ac39-455b-83be-50745a199545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ba0d38-7d2e-407e-8e15-4bd2ee9a3de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ba0d38-7d2e-407e-8e15-4bd2ee9a3de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511341985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3854670-0fcb-4274-9919-51444a6947f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f63399c06fe47509996d028e2e02634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:26:35Z,use_quota=True,user_id='bbe9dbd345eb4efc802016ed89e01d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c07e2f1-8ac5-4015-852a-8578f8dee4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c07e2f1-8ac5-4015-852a-8578f8dee4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec3762b-283e-44b3-af9f-dafc86bb72d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec3762b-283e-44b3-af9f-dafc86bb72d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3854670-0fcb-4274-9919-51444a6947f7', 'volume_name': 'volume-c3854670-0fcb-4274-9919-51444a6947f7', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23a5a8c-7842-4ad2-9d2a-5de18197be7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23a5a8c-7842-4ad2-9d2a-5de18197be7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9b524e-781a-4353-aa04-4bc6741cf21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:34 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Volume c3854670-0fcb-4274-9919-51444a6947f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3854670-0fcb-4274-9919-51444a6947f7', 'volume_size': 1} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511341985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3854670-0fcb-4274-9919-51444a6947f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f63399c06fe47509996d028e2e02634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:26:35Z,use_quota=True,user_id='bbe9dbd345eb4efc802016ed89e01d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Creating volume c3854670-0fcb-4274-9919-51444a6947f7 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:26:34 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a1c431b4-632c-45fe-b2d6-d33086ce8eb2 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-e0d07094-d5c3-4390-828a-492226a56742-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:34 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7 1073741824 Jul 22 12:26:34 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a1c431b4-632c-45fe-b2d6-d33086ce8eb2 tempest-ProjectMemberTests-872887571 None] Lock "cinder-e0d07094-d5c3-4390-828a-492226a56742-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a1c431b4-632c-45fe-b2d6-d33086ce8eb2 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a1c431b4-632c-45fe-b2d6-d33086ce8eb2 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a1c431b4-632c-45fe-b2d6-d33086ce8eb2 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-e0d07094-d5c3-4390-828a-492226a56742" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a1c431b4-632c-45fe-b2d6-d33086ce8eb2 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-e0d07094-d5c3-4390-828a-492226a56742" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-a1c431b4-632c-45fe-b2d6-d33086ce8eb2 tempest-ProjectMemberTests-872887571 None] Deleting offline snapshot e0d07094-d5c3-4390-828a-492226a56742 of volume 42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-a1c431b4-632c-45fe-b2d6-d33086ce8eb2 tempest-ProjectMemberTests-872887571 None] snapshot_file for this snap is: volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.e0d07094-d5c3-4390-828a-492226a56742 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[110b61c7-195a-4160-8a11-5873ebc32379]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:34 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a1c431b4-632c-45fe-b2d6-d33086ce8eb2 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.e0d07094-d5c3-4390-828a-492226a56742 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:35 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.e0d07094-d5c3-4390-828a-492226a56742 Jul 22 12:26:35 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:35 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7 1073741824" returned: 0 in 0.444s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:35 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7 Jul 22 12:26:35 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:35 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a1c431b4-632c-45fe-b2d6-d33086ce8eb2 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.e0d07094-d5c3-4390-828a-492226a56742" returned: 0 in 0.415s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-a1c431b4-632c-45fe-b2d6-d33086ce8eb2 tempest-ProjectMemberTests-872887571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:26:35 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[053dd68e-f990-498c-bc1e-705462220caa]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a1c431b4-632c-45fe-b2d6-d33086ce8eb2 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:35 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0 Jul 22 12:26:35 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:35 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7" returned: 0 in 0.249s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:26:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9b524e-781a-4353-aa04-4bc6741cf21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3854670-0fcb-4274-9919-51444a6947f7', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913720ff-2c82-4322-b69e-15a5365e86b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:35 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Volume volume-c3854670-0fcb-4274-9919-51444a6947f7 (c3854670-0fcb-4274-9919-51444a6947f7): created successfully Jul 22 12:26:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913720ff-2c82-4322-b69e-15a5365e86b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:35 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Flow 'volume_create_manager' (774011ff-ac39-455b-83be-50745a199545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:26:35 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-556c502a-362b-4406-9f97-217009258d24 tempest-ProjectReaderTests-831764688 None] Created volume successfully. Jul 22 12:26:35 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a1c431b4-632c-45fe-b2d6-d33086ce8eb2 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0" returned: 0 in 0.381s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a1c431b4-632c-45fe-b2d6-d33086ce8eb2 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.e0d07094-d5c3-4390-828a-492226a56742 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:35 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.e0d07094-d5c3-4390-828a-492226a56742 Jul 22 12:26:35 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dedcd01f-6ee3-491c-9140-2cfca355b5f3 tempest-ProjectReaderTests-831764688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:35 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dedcd01f-6ee3-491c-9140-2cfca355b5f3 tempest-ProjectReaderTests-831764688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:35 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-dedcd01f-6ee3-491c-9140-2cfca355b5f3 tempest-ProjectReaderTests-831764688 None] Creating offline snapshot 2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2 of volume c3854670-0fcb-4274-9919-51444a6947f7 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:26:36 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff32d1aa-0144-45ce-9d0e-2911d05505c4]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dedcd01f-6ee3-491c-9140-2cfca355b5f3 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:36 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7 Jul 22 12:26:36 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:36 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a1c431b4-632c-45fe-b2d6-d33086ce8eb2 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.e0d07094-d5c3-4390-828a-492226a56742" returned: 0 in 0.351s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a1c431b4-632c-45fe-b2d6-d33086ce8eb2 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.e0d07094-d5c3-4390-828a-492226a56742 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:36 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.e0d07094-d5c3-4390-828a-492226a56742 Jul 22 12:26:36 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:36 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dedcd01f-6ee3-491c-9140-2cfca355b5f3 tempest-ProjectReaderTests-831764688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7" returned: 0 in 0.372s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dedcd01f-6ee3-491c-9140-2cfca355b5f3 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:36 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2 1G Jul 22 12:26:36 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:36 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a1c431b4-632c-45fe-b2d6-d33086ce8eb2 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0.e0d07094-d5c3-4390-828a-492226a56742" returned: 0 in 0.253s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a1c431b4-632c-45fe-b2d6-d33086ce8eb2 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-e0d07094-d5c3-4390-828a-492226a56742" released by "_delete_snapshot" :: held 1.506s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a1c431b4-632c-45fe-b2d6-d33086ce8eb2 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0" released by "delete_snapshot" :: held 1.529s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:36 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-a1c431b4-632c-45fe-b2d6-d33086ce8eb2 tempest-ProjectMemberTests-872887571 None] Created reservations ['98ff3da6-4d10-42af-83d3-efcfff79209f', 'd6257c32-4ee1-4682-8066-d41cbc4831f5', '6c0f17bb-5882-4aae-9515-8a133d9dd0c0', 'f492fc59-5f99-46cb-851e-58dacbea60f6'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:36 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-a1c431b4-632c-45fe-b2d6-d33086ce8eb2 tempest-ProjectMemberTests-872887571 None] Delete snapshot completed successfully. Jul 22 12:26:36 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a1c431b4-632c-45fe-b2d6-d33086ce8eb2 tempest-ProjectMemberTests-872887571 None] Lock "cinder-e0d07094-d5c3-4390-828a-492226a56742-delete_snapshot" released by "delete_snapshot" :: held 1.659s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:36 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dedcd01f-6ee3-491c-9140-2cfca355b5f3 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2 1G" returned: 0 in 0.391s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:36 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dedcd01f-6ee3-491c-9140-2cfca355b5f3 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3854670-0fcb-4274-9919-51444a6947f7 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:36 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3854670-0fcb-4274-9919-51444a6947f7 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2 Jul 22 12:26:36 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:37 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2e50225a-ebb6-4532-875a-71f938d5e8ce tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dedcd01f-6ee3-491c-9140-2cfca355b5f3 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3854670-0fcb-4274-9919-51444a6947f7 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2" returned: 0 in 0.303s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:37 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-dedcd01f-6ee3-491c-9140-2cfca355b5f3 tempest-ProjectReaderTests-831764688 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2 is being set with open permissions: ugo+rw Jul 22 12:26:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dedcd01f-6ee3-491c-9140-2cfca355b5f3 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2e50225a-ebb6-4532-875a-71f938d5e8ce tempest-ProjectMemberTests-872887571 None] Lock "cinder-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:37 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2 Jul 22 12:26:37 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2e50225a-ebb6-4532-875a-71f938d5e8ce tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2e50225a-ebb6-4532-875a-71f938d5e8ce tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0" acquired by "delete_volume" :: waited 0.016s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:37 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ea1015-0673-42c1-b28a-292730890dd3]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2e50225a-ebb6-4532-875a-71f938d5e8ce tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:37 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0 Jul 22 12:26:37 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:37 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dedcd01f-6ee3-491c-9140-2cfca355b5f3 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2" returned: 0 in 0.279s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dedcd01f-6ee3-491c-9140-2cfca355b5f3 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:37 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.info Jul 22 12:26:37 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:37 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2e50225a-ebb6-4532-875a-71f938d5e8ce tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0" returned: 0 in 0.366s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2e50225a-ebb6-4532-875a-71f938d5e8ce tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:37 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0 Jul 22 12:26:37 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:37 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dedcd01f-6ee3-491c-9140-2cfca355b5f3 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.info" returned: 0 in 0.248s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:37 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-dedcd01f-6ee3-491c-9140-2cfca355b5f3 tempest-ProjectReaderTests-831764688 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.info is being set with open permissions: ugo+rw Jul 22 12:26:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dedcd01f-6ee3-491c-9140-2cfca355b5f3 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:37 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.info Jul 22 12:26:37 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:37 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2e50225a-ebb6-4532-875a-71f938d5e8ce tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0" returned: 0 in 0.273s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:37 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2e50225a-ebb6-4532-875a-71f938d5e8ce tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0" released by "delete_volume" :: held 0.697s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:37 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dedcd01f-6ee3-491c-9140-2cfca355b5f3 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.info" returned: 0 in 0.255s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:37 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dedcd01f-6ee3-491c-9140-2cfca355b5f3 tempest-ProjectReaderTests-831764688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:37 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-dedcd01f-6ee3-491c-9140-2cfca355b5f3 tempest-ProjectReaderTests-831764688 None] Create snapshot completed successfully Jul 22 12:26:37 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-2e50225a-ebb6-4532-875a-71f938d5e8ce tempest-ProjectMemberTests-872887571 None] Created reservations ['3442b450-5fe3-4b88-8d3b-5429b7fb56a4', '028f12ae-cc25-4e3c-842d-6f989faa9890', '42dfee49-e0e3-4ebf-bdcd-5584b6db8573', '6903c90a-0817-44a6-8b1f-fe8b18f480b7'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2e50225a-ebb6-4532-875a-71f938d5e8ce tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2e50225a-ebb6-4532-875a-71f938d5e8ce tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2e50225a-ebb6-4532-875a-71f938d5e8ce tempest-ProjectMemberTests-872887571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-2e50225a-ebb6-4532-875a-71f938d5e8ce tempest-ProjectMemberTests-872887571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2e50225a-ebb6-4532-875a-71f938d5e8ce tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2e50225a-ebb6-4532-875a-71f938d5e8ce tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:38 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:26:38 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3f4b223a-3a66-4a5a-8a35-81bcc4a77f41 tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3f4b223a-3a66-4a5a-8a35-81bcc4a77f41 tempest-ProjectReaderTests-831764688 None] Lock "cinder-2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3f4b223a-3a66-4a5a-8a35-81bcc4a77f41 tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-quobyte-c3854670-0fcb-4274-9919-51444a6947f7" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3f4b223a-3a66-4a5a-8a35-81bcc4a77f41 tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-c3854670-0fcb-4274-9919-51444a6947f7" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3f4b223a-3a66-4a5a-8a35-81bcc4a77f41 tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-quobyte-2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3f4b223a-3a66-4a5a-8a35-81bcc4a77f41 tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-3f4b223a-3a66-4a5a-8a35-81bcc4a77f41 tempest-ProjectReaderTests-831764688 None] Deleting offline snapshot 2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2 of volume c3854670-0fcb-4274-9919-51444a6947f7 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-3f4b223a-3a66-4a5a-8a35-81bcc4a77f41 tempest-ProjectReaderTests-831764688 None] snapshot_file for this snap is: volume-c3854670-0fcb-4274-9919-51444a6947f7.2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da32897-e00c-4da1-bc97-73bd3d728c3f]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3f4b223a-3a66-4a5a-8a35-81bcc4a77f41 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:38 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2e50225a-ebb6-4532-875a-71f938d5e8ce tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.279s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-2e50225a-ebb6-4532-875a-71f938d5e8ce tempest-ProjectMemberTests-872887571 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:26:38 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-2e50225a-ebb6-4532-875a-71f938d5e8ce tempest-ProjectMemberTests-872887571 None] Deleted volume successfully. Jul 22 12:26:38 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2 Jul 22 12:26:38 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-2e50225a-ebb6-4532-875a-71f938d5e8ce tempest-ProjectMemberTests-872887571 None] Lock "cinder-42bb5ea3-c3ac-4d43-803a-4bc6a8de6ac0-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:38 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3f4b223a-3a66-4a5a-8a35-81bcc4a77f41 tempest-ProjectReaderTests-831764688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2" returned: 0 in 0.403s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-3f4b223a-3a66-4a5a-8a35-81bcc4a77f41 tempest-ProjectReaderTests-831764688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3854670-0fcb-4274-9919-51444a6947f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce44d90e-0878-4976-bb80-c58af882ec6e]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3f4b223a-3a66-4a5a-8a35-81bcc4a77f41 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Flow 'volume_create_manager' (b7ded924-8320-4157-9338-f9e6f9beba8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f428d0-9014-4654-be97-d911d5fb8d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:38 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7 Jul 22 12:26:38 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f428d0-9014-4654-be97-d911d5fb8d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-459047823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef74cba6-b388-4c13-9a5f-2b6e040d82c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89707e5757184c76b39c42c3553f59c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:26:39Z,use_quota=True,user_id='edd7857f9fd44201b44894c8b9b98d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3970f2-93e5-4431-aef2-88b596496e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3970f2-93e5-4431-aef2-88b596496e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ea0a18-cb34-4684-b3b0-6837ab9c7318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ea0a18-cb34-4684-b3b0-6837ab9c7318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef74cba6-b388-4c13-9a5f-2b6e040d82c3', 'volume_name': 'volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f69c47-9e9d-4846-899e-78d04e6e3987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f69c47-9e9d-4846-899e-78d04e6e3987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27237452-f252-417a-8f72-96174f65ffc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:38 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Volume ef74cba6-b388-4c13-9a5f-2b6e040d82c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3', 'volume_size': 1} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-459047823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef74cba6-b388-4c13-9a5f-2b6e040d82c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89707e5757184c76b39c42c3553f59c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:26:39Z,use_quota=True,user_id='edd7857f9fd44201b44894c8b9b98d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Creating volume ef74cba6-b388-4c13-9a5f-2b6e040d82c3 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:26:38 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:26:38 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:38 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3 1073741824 Jul 22 12:26:38 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:39 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3f4b223a-3a66-4a5a-8a35-81bcc4a77f41 tempest-ProjectReaderTests-831764688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7" returned: 0 in 0.377s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3f4b223a-3a66-4a5a-8a35-81bcc4a77f41 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:39 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2 Jul 22 12:26:39 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:39 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3 1073741824" returned: 0 in 0.452s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:39 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3 Jul 22 12:26:39 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:39 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3f4b223a-3a66-4a5a-8a35-81bcc4a77f41 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2" returned: 0 in 0.367s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3f4b223a-3a66-4a5a-8a35-81bcc4a77f41 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:39 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2 Jul 22 12:26:39 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:39 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3" returned: 0 in 0.256s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27237452-f252-417a-8f72-96174f65ffc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f1eb002-bc68-4901-9418-3b10a5b3d2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:39 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Volume volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3 (ef74cba6-b388-4c13-9a5f-2b6e040d82c3): created successfully Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f1eb002-bc68-4901-9418-3b10a5b3d2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Flow 'volume_create_manager' (b7ded924-8320-4157-9338-f9e6f9beba8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:26:39 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-1916ad5d-b454-4107-a99c-90957e34eb31 tempest-ProjectMemberTests-872887571 None] Created volume successfully. Jul 22 12:26:39 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3f4b223a-3a66-4a5a-8a35-81bcc4a77f41 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7.2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2" returned: 0 in 0.265s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3f4b223a-3a66-4a5a-8a35-81bcc4a77f41 tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2" released by "_delete_snapshot" :: held 1.531s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3f4b223a-3a66-4a5a-8a35-81bcc4a77f41 tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-c3854670-0fcb-4274-9919-51444a6947f7" released by "delete_snapshot" :: held 1.557s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-3f4b223a-3a66-4a5a-8a35-81bcc4a77f41 tempest-ProjectReaderTests-831764688 None] Created reservations ['a77ed29f-9b84-442c-9606-2c24e20dcc52', '664baf96-917a-4586-a3ac-a66725d57941', 'f56d2854-deff-49ae-b57b-6c9ff5ffb1c9', '871d69fd-2bf1-4cd1-8719-f3fec82cc85f'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:39 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-3f4b223a-3a66-4a5a-8a35-81bcc4a77f41 tempest-ProjectReaderTests-831764688 None] Delete snapshot completed successfully. Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-3f4b223a-3a66-4a5a-8a35-81bcc4a77f41 tempest-ProjectReaderTests-831764688 None] Lock "cinder-2cc25ca8-c9c1-4164-ad02-0ce06e8c01b2-delete_snapshot" released by "delete_snapshot" :: held 1.698s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-422f5df3-6045-43c4-8f58-3ec6aaefa2c6 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-422f5df3-6045-43c4-8f58-3ec6aaefa2c6 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-422f5df3-6045-43c4-8f58-3ec6aaefa2c6 tempest-ProjectMemberTests-872887571 None] Creating offline snapshot 16aac872-4a00-4fba-af98-aa90626b79a5 of volume ef74cba6-b388-4c13-9a5f-2b6e040d82c3 {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[44516a61-abb7-4623-a842-25bff21b15e3]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:39 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-422f5df3-6045-43c4-8f58-3ec6aaefa2c6 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:40 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3 Jul 22 12:26:40 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a7460551-23fe-4128-9815-00ef5130d001 tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-c3854670-0fcb-4274-9919-51444a6947f7-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:40 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a7460551-23fe-4128-9815-00ef5130d001 tempest-ProjectReaderTests-831764688 None] Lock "cinder-c3854670-0fcb-4274-9919-51444a6947f7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-422f5df3-6045-43c4-8f58-3ec6aaefa2c6 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3" returned: 0 in 0.375s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-422f5df3-6045-43c4-8f58-3ec6aaefa2c6 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.16aac872-4a00-4fba-af98-aa90626b79a5 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:40 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.16aac872-4a00-4fba-af98-aa90626b79a5 1G Jul 22 12:26:40 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a7460551-23fe-4128-9815-00ef5130d001 tempest-ProjectReaderTests-831764688 None] Acquiring lock "cinder-quobyte-c3854670-0fcb-4274-9919-51444a6947f7" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:40 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a7460551-23fe-4128-9815-00ef5130d001 tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-c3854670-0fcb-4274-9919-51444a6947f7" acquired by "delete_volume" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:40 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b14ed9e-aaa0-4f67-bbc5-2d4d72558667]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a7460551-23fe-4128-9815-00ef5130d001 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:40 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7 Jul 22 12:26:40 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:40 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-422f5df3-6045-43c4-8f58-3ec6aaefa2c6 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.16aac872-4a00-4fba-af98-aa90626b79a5 1G" returned: 0 in 0.415s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-422f5df3-6045-43c4-8f58-3ec6aaefa2c6 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.16aac872-4a00-4fba-af98-aa90626b79a5 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:40 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.16aac872-4a00-4fba-af98-aa90626b79a5 Jul 22 12:26:40 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:40 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a7460551-23fe-4128-9815-00ef5130d001 tempest-ProjectReaderTests-831764688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7" returned: 0 in 0.375s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:40 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a7460551-23fe-4128-9815-00ef5130d001 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:40 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7 Jul 22 12:26:40 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:41 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-422f5df3-6045-43c4-8f58-3ec6aaefa2c6 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3 -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.16aac872-4a00-4fba-af98-aa90626b79a5" returned: 0 in 0.294s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:41 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-422f5df3-6045-43c4-8f58-3ec6aaefa2c6 tempest-ProjectMemberTests-872887571 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.16aac872-4a00-4fba-af98-aa90626b79a5 is being set with open permissions: ugo+rw Jul 22 12:26:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-422f5df3-6045-43c4-8f58-3ec6aaefa2c6 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.16aac872-4a00-4fba-af98-aa90626b79a5 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:41 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:41 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.16aac872-4a00-4fba-af98-aa90626b79a5 Jul 22 12:26:41 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a7460551-23fe-4128-9815-00ef5130d001 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-c3854670-0fcb-4274-9919-51444a6947f7" returned: 0 in 0.259s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a7460551-23fe-4128-9815-00ef5130d001 tempest-ProjectReaderTests-831764688 None] Lock "cinder-quobyte-c3854670-0fcb-4274-9919-51444a6947f7" released by "delete_volume" :: held 0.692s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:41 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-a7460551-23fe-4128-9815-00ef5130d001 tempest-ProjectReaderTests-831764688 None] Created reservations ['8b071943-2cbc-4d0c-9c01-45f873856642', 'ec349c1f-7353-4d23-b07f-70ac21a40006', '09e31e40-b98c-4766-bd5b-6764adabdf29', '07d49941-5479-4f93-ad59-37834139e22a'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a7460551-23fe-4128-9815-00ef5130d001 tempest-ProjectReaderTests-831764688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a7460551-23fe-4128-9815-00ef5130d001 tempest-ProjectReaderTests-831764688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a7460551-23fe-4128-9815-00ef5130d001 tempest-ProjectReaderTests-831764688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:41 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-a7460551-23fe-4128-9815-00ef5130d001 tempest-ProjectReaderTests-831764688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-a7460551-23fe-4128-9815-00ef5130d001 tempest-ProjectReaderTests-831764688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a7460551-23fe-4128-9815-00ef5130d001 tempest-ProjectReaderTests-831764688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:41 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:26:41 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:41 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-422f5df3-6045-43c4-8f58-3ec6aaefa2c6 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.16aac872-4a00-4fba-af98-aa90626b79a5" returned: 0 in 0.256s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-422f5df3-6045-43c4-8f58-3ec6aaefa2c6 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:41 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.info Jul 22 12:26:41 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:41 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-a7460551-23fe-4128-9815-00ef5130d001 tempest-ProjectReaderTests-831764688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.247s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:41 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-a7460551-23fe-4128-9815-00ef5130d001 tempest-ProjectReaderTests-831764688 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:26:41 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-a7460551-23fe-4128-9815-00ef5130d001 tempest-ProjectReaderTests-831764688 None] Deleted volume successfully. Jul 22 12:26:41 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-a7460551-23fe-4128-9815-00ef5130d001 tempest-ProjectReaderTests-831764688 None] Lock "cinder-c3854670-0fcb-4274-9919-51444a6947f7-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:41 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-422f5df3-6045-43c4-8f58-3ec6aaefa2c6 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.info" returned: 0 in 0.294s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:41 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-422f5df3-6045-43c4-8f58-3ec6aaefa2c6 tempest-ProjectMemberTests-872887571 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.info is being set with open permissions: ugo+rw Jul 22 12:26:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-422f5df3-6045-43c4-8f58-3ec6aaefa2c6 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:41 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.info Jul 22 12:26:41 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:41 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-422f5df3-6045-43c4-8f58-3ec6aaefa2c6 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.info" returned: 0 in 0.248s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:41 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-422f5df3-6045-43c4-8f58-3ec6aaefa2c6 tempest-ProjectMemberTests-872887571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:41 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-422f5df3-6045-43c4-8f58-3ec6aaefa2c6 tempest-ProjectMemberTests-872887571 None] Create snapshot completed successfully Jul 22 12:26:42 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ff67229e-febe-48ff-8352-3b9461f1ed77 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-16aac872-4a00-4fba-af98-aa90626b79a5-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:42 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ff67229e-febe-48ff-8352-3b9461f1ed77 tempest-ProjectMemberTests-872887571 None] Lock "cinder-16aac872-4a00-4fba-af98-aa90626b79a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:42 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ff67229e-febe-48ff-8352-3b9461f1ed77 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-ef74cba6-b388-4c13-9a5f-2b6e040d82c3" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:42 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ff67229e-febe-48ff-8352-3b9461f1ed77 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-ef74cba6-b388-4c13-9a5f-2b6e040d82c3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:42 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ff67229e-febe-48ff-8352-3b9461f1ed77 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-16aac872-4a00-4fba-af98-aa90626b79a5" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:42 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ff67229e-febe-48ff-8352-3b9461f1ed77 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-16aac872-4a00-4fba-af98-aa90626b79a5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-ff67229e-febe-48ff-8352-3b9461f1ed77 tempest-ProjectMemberTests-872887571 None] Deleting offline snapshot 16aac872-4a00-4fba-af98-aa90626b79a5 of volume ef74cba6-b388-4c13-9a5f-2b6e040d82c3 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:26:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-ff67229e-febe-48ff-8352-3b9461f1ed77 tempest-ProjectMemberTests-872887571 None] snapshot_file for this snap is: volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.16aac872-4a00-4fba-af98-aa90626b79a5 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:26:42 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f682041-af7d-4faa-9b19-664a29655f3f]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ff67229e-febe-48ff-8352-3b9461f1ed77 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.16aac872-4a00-4fba-af98-aa90626b79a5 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:42 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.16aac872-4a00-4fba-af98-aa90626b79a5 Jul 22 12:26:42 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:42 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ff67229e-febe-48ff-8352-3b9461f1ed77 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.16aac872-4a00-4fba-af98-aa90626b79a5" returned: 0 in 0.383s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:42 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-ff67229e-febe-48ff-8352-3b9461f1ed77 tempest-ProjectMemberTests-872887571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:26:42 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[4154a884-6a18-4f90-81eb-7dcd2090227c]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:42 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ff67229e-febe-48ff-8352-3b9461f1ed77 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:42 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3 Jul 22 12:26:42 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:43 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ff67229e-febe-48ff-8352-3b9461f1ed77 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3" returned: 0 in 0.403s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ff67229e-febe-48ff-8352-3b9461f1ed77 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.16aac872-4a00-4fba-af98-aa90626b79a5 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:43 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.16aac872-4a00-4fba-af98-aa90626b79a5 Jul 22 12:26:43 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:43 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ff67229e-febe-48ff-8352-3b9461f1ed77 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.16aac872-4a00-4fba-af98-aa90626b79a5" returned: 0 in 0.353s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ff67229e-febe-48ff-8352-3b9461f1ed77 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.16aac872-4a00-4fba-af98-aa90626b79a5 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:43 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.16aac872-4a00-4fba-af98-aa90626b79a5 Jul 22 12:26:43 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:43 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:43 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ff67229e-febe-48ff-8352-3b9461f1ed77 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3.16aac872-4a00-4fba-af98-aa90626b79a5" returned: 0 in 0.249s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:43 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ff67229e-febe-48ff-8352-3b9461f1ed77 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-16aac872-4a00-4fba-af98-aa90626b79a5" released by "_delete_snapshot" :: held 1.499s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:43 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ff67229e-febe-48ff-8352-3b9461f1ed77 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-ef74cba6-b388-4c13-9a5f-2b6e040d82c3" released by "delete_snapshot" :: held 1.526s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:43 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-ff67229e-febe-48ff-8352-3b9461f1ed77 tempest-ProjectMemberTests-872887571 None] Created reservations ['48efdf64-b747-46ec-b704-fd3a0f352b55', 'bfc0daaa-3971-49eb-a751-08aa5df91499', '9b29498d-7f9c-4009-9a13-213c501c7c11', '1c8fd000-6899-456f-b5aa-9ffb0d51225c'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:43 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-ff67229e-febe-48ff-8352-3b9461f1ed77 tempest-ProjectMemberTests-872887571 None] Delete snapshot completed successfully. Jul 22 12:26:43 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ff67229e-febe-48ff-8352-3b9461f1ed77 tempest-ProjectMemberTests-872887571 None] Lock "cinder-16aac872-4a00-4fba-af98-aa90626b79a5-delete_snapshot" released by "delete_snapshot" :: held 1.668s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:44 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ea7ca01b-1cd6-4d99-ac98-3ff68e49df64 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-ef74cba6-b388-4c13-9a5f-2b6e040d82c3-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:44 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ea7ca01b-1cd6-4d99-ac98-3ff68e49df64 tempest-ProjectMemberTests-872887571 None] Lock "cinder-ef74cba6-b388-4c13-9a5f-2b6e040d82c3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:44 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ea7ca01b-1cd6-4d99-ac98-3ff68e49df64 tempest-ProjectMemberTests-872887571 None] Acquiring lock "cinder-quobyte-ef74cba6-b388-4c13-9a5f-2b6e040d82c3" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:26:44 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ea7ca01b-1cd6-4d99-ac98-3ff68e49df64 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-ef74cba6-b388-4c13-9a5f-2b6e040d82c3" acquired by "delete_volume" :: waited 0.020s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:26:44 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c856b1-2e28-4337-80ce-59c2c0f5dba1]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:26:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ea7ca01b-1cd6-4d99-ac98-3ff68e49df64 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:44 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3 Jul 22 12:26:44 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:44 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ea7ca01b-1cd6-4d99-ac98-3ff68e49df64 tempest-ProjectMemberTests-872887571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3" returned: 0 in 0.377s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:44 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ea7ca01b-1cd6-4d99-ac98-3ff68e49df64 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:44 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3 Jul 22 12:26:44 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:45 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ea7ca01b-1cd6-4d99-ac98-3ff68e49df64 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-ef74cba6-b388-4c13-9a5f-2b6e040d82c3" returned: 0 in 0.269s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:45 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ea7ca01b-1cd6-4d99-ac98-3ff68e49df64 tempest-ProjectMemberTests-872887571 None] Lock "cinder-quobyte-ef74cba6-b388-4c13-9a5f-2b6e040d82c3" released by "delete_volume" :: held 0.715s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:45 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-ea7ca01b-1cd6-4d99-ac98-3ff68e49df64 tempest-ProjectMemberTests-872887571 None] Created reservations ['4465e429-3024-47c0-8d47-a95ad719305c', 'a51ef6c5-d2fa-488e-8871-90ec9f7307ff', 'f144c458-2a1a-4b90-9bc3-9bf8a0349cd4', '1010aaa7-a14b-49db-b564-fa22fa397840'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:26:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ea7ca01b-1cd6-4d99-ac98-3ff68e49df64 tempest-ProjectMemberTests-872887571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ea7ca01b-1cd6-4d99-ac98-3ff68e49df64 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ea7ca01b-1cd6-4d99-ac98-3ff68e49df64 tempest-ProjectMemberTests-872887571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:45 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-ea7ca01b-1cd6-4d99-ac98-3ff68e49df64 tempest-ProjectMemberTests-872887571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-ea7ca01b-1cd6-4d99-ac98-3ff68e49df64 tempest-ProjectMemberTests-872887571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ea7ca01b-1cd6-4d99-ac98-3ff68e49df64 tempest-ProjectMemberTests-872887571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:45 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:26:45 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:45 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:45 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-ea7ca01b-1cd6-4d99-ac98-3ff68e49df64 tempest-ProjectMemberTests-872887571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.256s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:45 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-ea7ca01b-1cd6-4d99-ac98-3ff68e49df64 tempest-ProjectMemberTests-872887571 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:26:45 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-ea7ca01b-1cd6-4d99-ac98-3ff68e49df64 tempest-ProjectMemberTests-872887571 None] Deleted volume successfully. Jul 22 12:26:45 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-ea7ca01b-1cd6-4d99-ac98-3ff68e49df64 tempest-ProjectMemberTests-872887571 None] Lock "cinder-ef74cba6-b388-4c13-9a5f-2b6e040d82c3-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:26:55 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=162,cinder:INSERT=62,cinder:UPDATE=213,cinder:DELETE=15 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:26:55 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=166,cinder:INSERT=58,cinder:UPDATE=220,cinder:DELETE=19 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:26:58 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:26:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Flow 'volume_create_manager' (5c67d311-a041-44b4-a79c-c80b38d64e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:26:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae68a45f-3092-46e6-8a28-94d1b7ed684c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae68a45f-3092-46e6-8a28-94d1b7ed684c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1291928768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e510d0-fcbc-48bc-896a-ba7cffd375bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c323d9d56780481488d79a4461272674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:26:58Z,use_quota=True,user_id='b24b05a8376b4690b2ee93e731b91dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b449745-cb70-4802-b843-706b809ff77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b449745-cb70-4802-b843-706b809ff77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5a4147c-b3c5-4147-813d-658b38740df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5a4147c-b3c5-4147-813d-658b38740df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05e510d0-fcbc-48bc-896a-ba7cffd375bc', 'volume_name': 'volume-05e510d0-fcbc-48bc-896a-ba7cffd375bc', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (556ffaab-cff2-4868-977d-b2ee0a82f8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (556ffaab-cff2-4868-977d-b2ee0a82f8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:58 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ffd559-e7ac-46a0-ae05-ecf5e1ed5fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:58 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Volume 05e510d0-fcbc-48bc-896a-ba7cffd375bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05e510d0-fcbc-48bc-896a-ba7cffd375bc', 'volume_size': 1} Jul 22 12:26:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1291928768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e510d0-fcbc-48bc-896a-ba7cffd375bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c323d9d56780481488d79a4461272674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:26:58Z,use_quota=True,user_id='b24b05a8376b4690b2ee93e731b91dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:26:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Creating volume 05e510d0-fcbc-48bc-896a-ba7cffd375bc {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:26:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:26:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:26:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:26:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:26:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:58 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:26:58 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:26:58 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-05e510d0-fcbc-48bc-896a-ba7cffd375bc 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:58 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-05e510d0-fcbc-48bc-896a-ba7cffd375bc 1073741824 Jul 22 12:26:58 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:59 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-05e510d0-fcbc-48bc-896a-ba7cffd375bc 1073741824" returned: 0 in 0.456s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-05e510d0-fcbc-48bc-896a-ba7cffd375bc {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:26:59 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-05e510d0-fcbc-48bc-896a-ba7cffd375bc Jul 22 12:26:59 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:26:59 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 22 12:26:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-05e510d0-fcbc-48bc-896a-ba7cffd375bc" returned: 0 in 0.252s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:26:59 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:26:59 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:26:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ffd559-e7ac-46a0-ae05-ecf5e1ed5fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05e510d0-fcbc-48bc-896a-ba7cffd375bc', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7153edff-ab55-47a3-be2d-40498b2bae7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:26:59 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Volume volume-05e510d0-fcbc-48bc-896a-ba7cffd375bc (05e510d0-fcbc-48bc-896a-ba7cffd375bc): created successfully Jul 22 12:26:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7153edff-ab55-47a3-be2d-40498b2bae7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:26:59 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Flow 'volume_create_manager' (5c67d311-a041-44b4-a79c-c80b38d64e21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:26:59 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-fec0d616-fa2c-47ec-8ef1-44b3032c4124 tempest-ProjectReaderTests-1874264973 None] Created volume successfully. Jul 22 12:27:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0d68218e-602f-4ada-b297-55ed5ad89864 tempest-ProjectReaderTests-1874264973 None] Acquiring lock "cinder-05e510d0-fcbc-48bc-896a-ba7cffd375bc-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:27:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0d68218e-602f-4ada-b297-55ed5ad89864 tempest-ProjectReaderTests-1874264973 None] Lock "cinder-05e510d0-fcbc-48bc-896a-ba7cffd375bc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:27:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0d68218e-602f-4ada-b297-55ed5ad89864 tempest-ProjectReaderTests-1874264973 None] Acquiring lock "cinder-quobyte-05e510d0-fcbc-48bc-896a-ba7cffd375bc" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:27:00 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0d68218e-602f-4ada-b297-55ed5ad89864 tempest-ProjectReaderTests-1874264973 None] Lock "cinder-quobyte-05e510d0-fcbc-48bc-896a-ba7cffd375bc" acquired by "delete_volume" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:27:00 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbda24d-eca7-4f19-8213-f0acc5a89aac]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:27:00 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0d68218e-602f-4ada-b297-55ed5ad89864 tempest-ProjectReaderTests-1874264973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-05e510d0-fcbc-48bc-896a-ba7cffd375bc {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:00 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-05e510d0-fcbc-48bc-896a-ba7cffd375bc Jul 22 12:27:00 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:01 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0d68218e-602f-4ada-b297-55ed5ad89864 tempest-ProjectReaderTests-1874264973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-05e510d0-fcbc-48bc-896a-ba7cffd375bc" returned: 0 in 0.376s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0d68218e-602f-4ada-b297-55ed5ad89864 tempest-ProjectReaderTests-1874264973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-05e510d0-fcbc-48bc-896a-ba7cffd375bc {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:01 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-05e510d0-fcbc-48bc-896a-ba7cffd375bc Jul 22 12:27:01 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:01 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0d68218e-602f-4ada-b297-55ed5ad89864 tempest-ProjectReaderTests-1874264973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-05e510d0-fcbc-48bc-896a-ba7cffd375bc" returned: 0 in 0.280s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:01 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0d68218e-602f-4ada-b297-55ed5ad89864 tempest-ProjectReaderTests-1874264973 None] Lock "cinder-quobyte-05e510d0-fcbc-48bc-896a-ba7cffd375bc" released by "delete_volume" :: held 0.722s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:27:01 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-0d68218e-602f-4ada-b297-55ed5ad89864 tempest-ProjectReaderTests-1874264973 None] Created reservations ['ed409a0e-1b1d-4f07-bd9d-9300f402a65c', '948bf4fa-fb31-44d4-9b39-bd29e89012c0', '77881193-760e-4280-b193-7806ed0ec1ff', '09f0907d-e91a-449a-8f16-f20d1778118f'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:27:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0d68218e-602f-4ada-b297-55ed5ad89864 tempest-ProjectReaderTests-1874264973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:27:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0d68218e-602f-4ada-b297-55ed5ad89864 tempest-ProjectReaderTests-1874264973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:27:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0d68218e-602f-4ada-b297-55ed5ad89864 tempest-ProjectReaderTests-1874264973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:27:01 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0d68218e-602f-4ada-b297-55ed5ad89864 tempest-ProjectReaderTests-1874264973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:27:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0d68218e-602f-4ada-b297-55ed5ad89864 tempest-ProjectReaderTests-1874264973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:27:01 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0d68218e-602f-4ada-b297-55ed5ad89864 tempest-ProjectReaderTests-1874264973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:01 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:27:01 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:02 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0d68218e-602f-4ada-b297-55ed5ad89864 tempest-ProjectReaderTests-1874264973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.320s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0d68218e-602f-4ada-b297-55ed5ad89864 tempest-ProjectReaderTests-1874264973 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:27:02 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-0d68218e-602f-4ada-b297-55ed5ad89864 tempest-ProjectReaderTests-1874264973 None] Deleted volume successfully. Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-0d68218e-602f-4ada-b297-55ed5ad89864 tempest-ProjectReaderTests-1874264973 None] Lock "cinder-05e510d0-fcbc-48bc-896a-ba7cffd375bc-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Flow 'volume_create_manager' (4424493e-d484-4ee3-9856-de3865686f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02398a7a-94de-4db3-b610-9e2a5e88b071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02398a7a-94de-4db3-b610-9e2a5e88b071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-440952020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa1c8954-6fb7-4359-a78e-c52e09a587b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c323d9d56780481488d79a4461272674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:27:02Z,use_quota=True,user_id='b24b05a8376b4690b2ee93e731b91dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86bea15a-9109-4dd7-bb88-441190e4e0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86bea15a-9109-4dd7-bb88-441190e4e0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36cfe64c-4c0a-4045-8332-4140cd10edee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36cfe64c-4c0a-4045-8332-4140cd10edee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa1c8954-6fb7-4359-a78e-c52e09a587b8', 'volume_name': 'volume-aa1c8954-6fb7-4359-a78e-c52e09a587b8', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1735e0b8-92ad-4ce0-9cd6-4794a6fa17aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1735e0b8-92ad-4ce0-9cd6-4794a6fa17aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f9c9849-fcbb-4797-9432-63139c7d0cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:02 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Volume aa1c8954-6fb7-4359-a78e-c52e09a587b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa1c8954-6fb7-4359-a78e-c52e09a587b8', 'volume_size': 1} Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-440952020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa1c8954-6fb7-4359-a78e-c52e09a587b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c323d9d56780481488d79a4461272674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:27:02Z,use_quota=True,user_id='b24b05a8376b4690b2ee93e731b91dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Creating volume aa1c8954-6fb7-4359-a78e-c52e09a587b8 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:27:02 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:27:02 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa1c8954-6fb7-4359-a78e-c52e09a587b8 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:02 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa1c8954-6fb7-4359-a78e-c52e09a587b8 1073741824 Jul 22 12:27:02 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:03 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa1c8954-6fb7-4359-a78e-c52e09a587b8 1073741824" returned: 0 in 0.476s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa1c8954-6fb7-4359-a78e-c52e09a587b8 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:03 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa1c8954-6fb7-4359-a78e-c52e09a587b8 Jul 22 12:27:03 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:03 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa1c8954-6fb7-4359-a78e-c52e09a587b8" returned: 0 in 0.258s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:03 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:27:03 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:27:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f9c9849-fcbb-4797-9432-63139c7d0cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa1c8954-6fb7-4359-a78e-c52e09a587b8', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95bb8ea4-1ed3-46bf-86f3-3466c06a72d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:03 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Volume volume-aa1c8954-6fb7-4359-a78e-c52e09a587b8 (aa1c8954-6fb7-4359-a78e-c52e09a587b8): created successfully Jul 22 12:27:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95bb8ea4-1ed3-46bf-86f3-3466c06a72d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:03 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Flow 'volume_create_manager' (4424493e-d484-4ee3-9856-de3865686f95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:27:03 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-3d4a6950-d923-406a-8c65-b114523cb9bc tempest-ProjectReaderTests-1874264973 None] Created volume successfully. Jul 22 12:27:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-68fcca2c-f939-4d72-8edc-2f22a4d6a679 tempest-ProjectReaderTests-1874264973 None] Acquiring lock "cinder-aa1c8954-6fb7-4359-a78e-c52e09a587b8-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:27:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-68fcca2c-f939-4d72-8edc-2f22a4d6a679 tempest-ProjectReaderTests-1874264973 None] Lock "cinder-aa1c8954-6fb7-4359-a78e-c52e09a587b8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:27:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-68fcca2c-f939-4d72-8edc-2f22a4d6a679 tempest-ProjectReaderTests-1874264973 None] Acquiring lock "cinder-quobyte-aa1c8954-6fb7-4359-a78e-c52e09a587b8" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:27:04 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-68fcca2c-f939-4d72-8edc-2f22a4d6a679 tempest-ProjectReaderTests-1874264973 None] Lock "cinder-quobyte-aa1c8954-6fb7-4359-a78e-c52e09a587b8" acquired by "delete_volume" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:27:04 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ba5cd4-bb71-43ba-a7ff-47dfa3532489]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:27:04 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-68fcca2c-f939-4d72-8edc-2f22a4d6a679 tempest-ProjectReaderTests-1874264973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa1c8954-6fb7-4359-a78e-c52e09a587b8 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:04 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa1c8954-6fb7-4359-a78e-c52e09a587b8 Jul 22 12:27:04 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:05 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-68fcca2c-f939-4d72-8edc-2f22a4d6a679 tempest-ProjectReaderTests-1874264973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa1c8954-6fb7-4359-a78e-c52e09a587b8" returned: 0 in 0.377s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-68fcca2c-f939-4d72-8edc-2f22a4d6a679 tempest-ProjectReaderTests-1874264973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa1c8954-6fb7-4359-a78e-c52e09a587b8 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:05 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa1c8954-6fb7-4359-a78e-c52e09a587b8 Jul 22 12:27:05 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:05 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-68fcca2c-f939-4d72-8edc-2f22a4d6a679 tempest-ProjectReaderTests-1874264973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-aa1c8954-6fb7-4359-a78e-c52e09a587b8" returned: 0 in 0.256s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-68fcca2c-f939-4d72-8edc-2f22a4d6a679 tempest-ProjectReaderTests-1874264973 None] Lock "cinder-quobyte-aa1c8954-6fb7-4359-a78e-c52e09a587b8" released by "delete_volume" :: held 0.672s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:27:05 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-68fcca2c-f939-4d72-8edc-2f22a4d6a679 tempest-ProjectReaderTests-1874264973 None] Created reservations ['3e33adc0-13b1-45af-96f3-16559f257baf', '1af96715-b1e8-4582-aa9e-9128e37c76f3', '1999face-ddff-4ad6-9b3e-d1bb6ad24a48', '40221a23-2ad5-440a-a94b-e2f8b9644258'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:27:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-68fcca2c-f939-4d72-8edc-2f22a4d6a679 tempest-ProjectReaderTests-1874264973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:27:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-68fcca2c-f939-4d72-8edc-2f22a4d6a679 tempest-ProjectReaderTests-1874264973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:27:05 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-68fcca2c-f939-4d72-8edc-2f22a4d6a679 tempest-ProjectReaderTests-1874264973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:27:05 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-68fcca2c-f939-4d72-8edc-2f22a4d6a679 tempest-ProjectReaderTests-1874264973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:27:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-68fcca2c-f939-4d72-8edc-2f22a4d6a679 tempest-ProjectReaderTests-1874264973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:27:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-68fcca2c-f939-4d72-8edc-2f22a4d6a679 tempest-ProjectReaderTests-1874264973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:05 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:27:05 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:05 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:05 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-68fcca2c-f939-4d72-8edc-2f22a4d6a679 tempest-ProjectReaderTests-1874264973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.332s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:05 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-68fcca2c-f939-4d72-8edc-2f22a4d6a679 tempest-ProjectReaderTests-1874264973 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:27:05 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-68fcca2c-f939-4d72-8edc-2f22a4d6a679 tempest-ProjectReaderTests-1874264973 None] Deleted volume successfully. Jul 22 12:27:05 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-68fcca2c-f939-4d72-8edc-2f22a4d6a679 tempest-ProjectReaderTests-1874264973 None] Lock "cinder-aa1c8954-6fb7-4359-a78e-c52e09a587b8-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:27:06 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:27:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Flow 'volume_create_manager' (706b6410-10ba-42e6-9574-5d989d9ae28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:27:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef37028b-f9cb-4db2-85c0-48957a7f175c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef37028b-f9cb-4db2-85c0-48957a7f175c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1918300872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bdd9521-3088-402a-bc80-ea771a5657f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c323d9d56780481488d79a4461272674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:27:06Z,use_quota=True,user_id='b24b05a8376b4690b2ee93e731b91dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4979c0f6-094e-4f77-8c29-c8d40690ab41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4979c0f6-094e-4f77-8c29-c8d40690ab41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a320b794-7492-4463-8e20-08eb6508bb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a320b794-7492-4463-8e20-08eb6508bb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bdd9521-3088-402a-bc80-ea771a5657f7', 'volume_name': 'volume-4bdd9521-3088-402a-bc80-ea771a5657f7', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707ece16-1728-42ca-8fa9-cbfc7fa18ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707ece16-1728-42ca-8fa9-cbfc7fa18ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:06 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99e39ab-de36-4213-8590-a082f2a6a3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:06 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Volume 4bdd9521-3088-402a-bc80-ea771a5657f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bdd9521-3088-402a-bc80-ea771a5657f7', 'volume_size': 1} Jul 22 12:27:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:27:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:27:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1918300872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bdd9521-3088-402a-bc80-ea771a5657f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c323d9d56780481488d79a4461272674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:27:06Z,use_quota=True,user_id='b24b05a8376b4690b2ee93e731b91dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:27:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Creating volume 4bdd9521-3088-402a-bc80-ea771a5657f7 {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:27:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:27:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:27:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:27:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:27:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:27:06 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:27:06 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:27:06 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4bdd9521-3088-402a-bc80-ea771a5657f7 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:06 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4bdd9521-3088-402a-bc80-ea771a5657f7 1073741824 Jul 22 12:27:06 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:07 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4bdd9521-3088-402a-bc80-ea771a5657f7 1073741824" returned: 0 in 0.544s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4bdd9521-3088-402a-bc80-ea771a5657f7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:07 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4bdd9521-3088-402a-bc80-ea771a5657f7 Jul 22 12:27:07 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:07 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4bdd9521-3088-402a-bc80-ea771a5657f7" returned: 0 in 0.267s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99e39ab-de36-4213-8590-a082f2a6a3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bdd9521-3088-402a-bc80-ea771a5657f7', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9999692c-b477-4ed8-9728-b0860a363b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:07 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Volume volume-4bdd9521-3088-402a-bc80-ea771a5657f7 (4bdd9521-3088-402a-bc80-ea771a5657f7): created successfully Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9999692c-b477-4ed8-9728-b0860a363b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Flow 'volume_create_manager' (706b6410-10ba-42e6-9574-5d989d9ae28c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:27:07 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-d275593b-823d-4067-a8d8-d81b67a29e2f tempest-ProjectReaderTests-1874264973 None] Created volume successfully. Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Flow 'volume_create_manager' (d351ebb2-78aa-4dbb-b3f9-a9b43b9a6cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c4e15b-426a-4f0c-8e65-9bf50b8395c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c4e15b-426a-4f0c-8e65-9bf50b8395c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-321108484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64bbea98-22c9-4cc7-8513-c3d8e2d6445e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd6ceb5aec14f7b964e2f0562f77071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:27:07Z,use_quota=True,user_id='1e8fad5cd17f40479fc0d39b84bcf9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e787b917-9ca7-4959-8908-f2a8f8324972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e787b917-9ca7-4959-8908-f2a8f8324972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e373a8-f809-4687-82ec-6f1415518b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e373a8-f809-4687-82ec-6f1415518b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64bbea98-22c9-4cc7-8513-c3d8e2d6445e', 'volume_name': 'volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc9ae5ca-d5a1-42c6-a474-7f4a144673a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc9ae5ca-d5a1-42c6-a474-7f4a144673a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d3c7eb-3ef5-482c-a712-469d6f58d4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:07 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Volume 64bbea98-22c9-4cc7-8513-c3d8e2d6445e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e', 'volume_size': 1} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-321108484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64bbea98-22c9-4cc7-8513-c3d8e2d6445e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd6ceb5aec14f7b964e2f0562f77071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:27:07Z,use_quota=True,user_id='1e8fad5cd17f40479fc0d39b84bcf9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Creating volume 64bbea98-22c9-4cc7-8513-c3d8e2d6445e {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:27:07 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:27:07 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:07 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e 1073741824 Jul 22 12:27:07 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:08 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e 1073741824" returned: 0 in 0.415s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:08 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e Jul 22 12:27:08 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:08 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e" returned: 0 in 0.249s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:27:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:27:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d3c7eb-3ef5-482c-a712-469d6f58d4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81475722-df2a-4935-bef2-bef691672963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:08 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Volume volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e (64bbea98-22c9-4cc7-8513-c3d8e2d6445e): created successfully Jul 22 12:27:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81475722-df2a-4935-bef2-bef691672963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:08 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Flow 'volume_create_manager' (d351ebb2-78aa-4dbb-b3f9-a9b43b9a6cf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:27:08 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-f2946195-0b4c-48c7-ab42-2e31187a516f tempest-SnapshotDependencyTests-143012724 None] Created volume successfully. Jul 22 12:27:08 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1a333caa-2391-4a3c-85d0-f168f2d177f4 tempest-ProjectReaderTests-1874264973 None] Acquiring lock "cinder-4bdd9521-3088-402a-bc80-ea771a5657f7-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:27:08 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1a333caa-2391-4a3c-85d0-f168f2d177f4 tempest-ProjectReaderTests-1874264973 None] Lock "cinder-4bdd9521-3088-402a-bc80-ea771a5657f7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:27:08 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1a333caa-2391-4a3c-85d0-f168f2d177f4 tempest-ProjectReaderTests-1874264973 None] Acquiring lock "cinder-quobyte-4bdd9521-3088-402a-bc80-ea771a5657f7" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:27:08 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1a333caa-2391-4a3c-85d0-f168f2d177f4 tempest-ProjectReaderTests-1874264973 None] Lock "cinder-quobyte-4bdd9521-3088-402a-bc80-ea771a5657f7" acquired by "delete_volume" :: waited 0.015s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:27:08 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e72be27-ce85-41b6-ac61-3d99ed5ce469]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:27:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1a333caa-2391-4a3c-85d0-f168f2d177f4 tempest-ProjectReaderTests-1874264973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4bdd9521-3088-402a-bc80-ea771a5657f7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:08 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4bdd9521-3088-402a-bc80-ea771a5657f7 Jul 22 12:27:08 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2bfaf5c9-bea2-452e-9349-cd9390281c31 tempest-SnapshotDependencyTests-143012724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:27:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2bfaf5c9-bea2-452e-9349-cd9390281c31 tempest-SnapshotDependencyTests-143012724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:27:08 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-2bfaf5c9-bea2-452e-9349-cd9390281c31 tempest-SnapshotDependencyTests-143012724 None] Creating offline snapshot 05b42aa3-53a5-4426-8cdd-f4e0e022f869 of volume 64bbea98-22c9-4cc7-8513-c3d8e2d6445e {{(pid=87568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 12:27:08 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[920e8a12-1465-4193-999e-eddb95c5572b]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:27:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2bfaf5c9-bea2-452e-9349-cd9390281c31 tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:08 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e Jul 22 12:27:08 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:08 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1a333caa-2391-4a3c-85d0-f168f2d177f4 tempest-ProjectReaderTests-1874264973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4bdd9521-3088-402a-bc80-ea771a5657f7" returned: 0 in 0.389s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:08 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1a333caa-2391-4a3c-85d0-f168f2d177f4 tempest-ProjectReaderTests-1874264973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4bdd9521-3088-402a-bc80-ea771a5657f7 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:09 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4bdd9521-3088-402a-bc80-ea771a5657f7 Jul 22 12:27:09 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:09 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2bfaf5c9-bea2-452e-9349-cd9390281c31 tempest-SnapshotDependencyTests-143012724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e" returned: 0 in 0.366s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2bfaf5c9-bea2-452e-9349-cd9390281c31 tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869 1G {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:09 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869 1G Jul 22 12:27:09 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:09 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1a333caa-2391-4a3c-85d0-f168f2d177f4 tempest-ProjectReaderTests-1874264973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-4bdd9521-3088-402a-bc80-ea771a5657f7" returned: 0 in 0.252s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:09 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1a333caa-2391-4a3c-85d0-f168f2d177f4 tempest-ProjectReaderTests-1874264973 None] Lock "cinder-quobyte-4bdd9521-3088-402a-bc80-ea771a5657f7" released by "delete_volume" :: held 0.691s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:27:09 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-1a333caa-2391-4a3c-85d0-f168f2d177f4 tempest-ProjectReaderTests-1874264973 None] Created reservations ['e5fd965a-bcc0-4654-9001-1229bccdd09f', '7787482a-d1f1-43a3-8415-9ca5d48000e2', 'abab15dd-0ef5-4633-8bf9-69091aad4f98', 'a2650cab-b67f-4a2b-afba-8484b7fb4619'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:27:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1a333caa-2391-4a3c-85d0-f168f2d177f4 tempest-ProjectReaderTests-1874264973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:27:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1a333caa-2391-4a3c-85d0-f168f2d177f4 tempest-ProjectReaderTests-1874264973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:27:09 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1a333caa-2391-4a3c-85d0-f168f2d177f4 tempest-ProjectReaderTests-1874264973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:27:09 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-1a333caa-2391-4a3c-85d0-f168f2d177f4 tempest-ProjectReaderTests-1874264973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:27:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-1a333caa-2391-4a3c-85d0-f168f2d177f4 tempest-ProjectReaderTests-1874264973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:27:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1a333caa-2391-4a3c-85d0-f168f2d177f4 tempest-ProjectReaderTests-1874264973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:09 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:27:09 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:09 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2bfaf5c9-bea2-452e-9349-cd9390281c31 tempest-SnapshotDependencyTests-143012724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869 1G" returned: 0 in 0.420s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2bfaf5c9-bea2-452e-9349-cd9390281c31 tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:09 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869 Jul 22 12:27:09 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:09 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-1a333caa-2391-4a3c-85d0-f168f2d177f4 tempest-ProjectReaderTests-1874264973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.263s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:09 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-1a333caa-2391-4a3c-85d0-f168f2d177f4 tempest-ProjectReaderTests-1874264973 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:27:09 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-1a333caa-2391-4a3c-85d0-f168f2d177f4 tempest-ProjectReaderTests-1874264973 None] Deleted volume successfully. Jul 22 12:27:09 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-1a333caa-2391-4a3c-85d0-f168f2d177f4 tempest-ProjectReaderTests-1874264973 None] Lock "cinder-4bdd9521-3088-402a-bc80-ea771a5657f7-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:27:09 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2bfaf5c9-bea2-452e-9349-cd9390281c31 tempest-SnapshotDependencyTests-143012724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e -F qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869" returned: 0 in 0.309s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:09 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-2bfaf5c9-bea2-452e-9349-cd9390281c31 tempest-SnapshotDependencyTests-143012724 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869 is being set with open permissions: ugo+rw Jul 22 12:27:09 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2bfaf5c9-bea2-452e-9349-cd9390281c31 tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:09 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869 Jul 22 12:27:09 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Flow 'volume_create_manager' (99b248fd-fb60-44f1-8d62-15e475197b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3211ad42-1b26-41c8-a93a-50040526e971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:10 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2bfaf5c9-bea2-452e-9349-cd9390281c31 tempest-SnapshotDependencyTests-143012724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869" returned: 0 in 0.277s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3211ad42-1b26-41c8-a93a-50040526e971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1332003246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be10150-56a4-4927-81d3-08bb9ccb768b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c323d9d56780481488d79a4461272674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:27:10Z,use_quota=True,user_id='b24b05a8376b4690b2ee93e731b91dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0446013f-b3fe-4d60-89ff-fd82767e6aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0446013f-b3fe-4d60-89ff-fd82767e6aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5dd43c3-9188-456e-bab4-a8b09f54f9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5dd43c3-9188-456e-bab4-a8b09f54f9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1be10150-56a4-4927-81d3-08bb9ccb768b', 'volume_name': 'volume-1be10150-56a4-4927-81d3-08bb9ccb768b', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d15f758-0e26-4e14-b4c0-bf02a0dc79b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d15f758-0e26-4e14-b4c0-bf02a0dc79b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbdbeb5-af98-4af5-8bd2-e01a27a50b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:10 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Volume 1be10150-56a4-4927-81d3-08bb9ccb768b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1be10150-56a4-4927-81d3-08bb9ccb768b', 'volume_size': 1} Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2bfaf5c9-bea2-452e-9349-cd9390281c31 tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:10 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.info Jul 22 12:27:10 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:10 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2bfaf5c9-bea2-452e-9349-cd9390281c31 tempest-SnapshotDependencyTests-143012724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.info" returned: 0 in 0.249s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:10 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-2bfaf5c9-bea2-452e-9349-cd9390281c31 tempest-SnapshotDependencyTests-143012724 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.info is being set with open permissions: ugo+rw Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2bfaf5c9-bea2-452e-9349-cd9390281c31 tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.info {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:10 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.info Jul 22 12:27:10 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:10 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-2bfaf5c9-bea2-452e-9349-cd9390281c31 tempest-SnapshotDependencyTests-143012724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.info" returned: 0 in 0.243s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-2bfaf5c9-bea2-452e-9349-cd9390281c31 tempest-SnapshotDependencyTests-143012724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.993s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.534s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1332003246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be10150-56a4-4927-81d3-08bb9ccb768b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c323d9d56780481488d79a4461272674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:27:10Z,use_quota=True,user_id='b24b05a8376b4690b2ee93e731b91dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)}" {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Creating volume 1be10150-56a4-4927-81d3-08bb9ccb768b {{(pid=87568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:27:10 devstack cinder-volume[87568]: INFO cinder.volume.drivers.remotefs [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] casted to osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 Jul 22 12:27:10 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1be10150-56a4-4927-81d3-08bb9ccb768b 1073741824 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:10 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1be10150-56a4-4927-81d3-08bb9ccb768b 1073741824 Jul 22 12:27:10 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:10 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-2bfaf5c9-bea2-452e-9349-cd9390281c31 tempest-SnapshotDependencyTests-143012724 None] Create snapshot completed successfully Jul 22 12:27:11 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1be10150-56a4-4927-81d3-08bb9ccb768b 1073741824" returned: 0 in 0.419s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1be10150-56a4-4927-81d3-08bb9ccb768b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:11 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1be10150-56a4-4927-81d3-08bb9ccb768b Jul 22 12:27:11 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:11 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1be10150-56a4-4927-81d3-08bb9ccb768b" returned: 0 in 0.245s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:11 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'} {{(pid=87568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 12:27:11 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:27:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbdbeb5-af98-4af5-8bd2-e01a27a50b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1be10150-56a4-4927-81d3-08bb9ccb768b', 'volume_size': 1}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1155b2f-300f-4915-8e35-5732689964b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:11 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Volume volume-1be10150-56a4-4927-81d3-08bb9ccb768b (1be10150-56a4-4927-81d3-08bb9ccb768b): created successfully Jul 22 12:27:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1155b2f-300f-4915-8e35-5732689964b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:11 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Flow 'volume_create_manager' (99b248fd-fb60-44f1-8d62-15e475197b0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:27:11 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-0d4387fe-4fda-4d51-8411-f3defc8fd0f1 tempest-ProjectReaderTests-1874264973 None] Created volume successfully. Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-668db037-ce58-42d5-be92-7c3048fa3402 tempest-ProjectReaderTests-1874264973 None] Acquiring lock "cinder-1be10150-56a4-4927-81d3-08bb9ccb768b-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-668db037-ce58-42d5-be92-7c3048fa3402 tempest-ProjectReaderTests-1874264973 None] Lock "cinder-1be10150-56a4-4927-81d3-08bb9ccb768b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-668db037-ce58-42d5-be92-7c3048fa3402 tempest-ProjectReaderTests-1874264973 None] Acquiring lock "cinder-quobyte-1be10150-56a4-4927-81d3-08bb9ccb768b" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-668db037-ce58-42d5-be92-7c3048fa3402 tempest-ProjectReaderTests-1874264973 None] Lock "cinder-quobyte-1be10150-56a4-4927-81d3-08bb9ccb768b" acquired by "delete_volume" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[418c4075-d684-4d69-b4ed-168a8c380e7e]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-668db037-ce58-42d5-be92-7c3048fa3402 tempest-ProjectReaderTests-1874264973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1be10150-56a4-4927-81d3-08bb9ccb768b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:12 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1be10150-56a4-4927-81d3-08bb9ccb768b Jul 22 12:27:12 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.volume.flows.manager.create_volume [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Flow 'volume_create_manager' (b3ea7fbb-278f-4416-8c22-d68f5f699f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646138d2-c2f6-4ec0-838a-ab13059dfca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646138d2-c2f6-4ec0-838a-ab13059dfca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T10:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b0f9bb-cf9d-453c-8b9f-b180a43d9bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd6ceb5aec14f7b964e2f0562f77071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T10:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=05b42aa3-53a5-4426-8cdd-f4e0e022f869,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T10:27:12Z,use_quota=True,user_id='1e8fad5cd17f40479fc0d39b84bcf9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e585c5b9-8eec-4594-b90f-0f88cebf76e1),volume_type_id=e585c5b9-8eec-4594-b90f-0f88cebf76e1)' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61dff29d-87d2-4328-a92b-a1ed4174d5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61dff29d-87d2-4328-a92b-a1ed4174d5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a98666-de7c-47af-acc6-fa9b9a062848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a98666-de7c-47af-acc6-fa9b9a062848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '71b0f9bb-cf9d-453c-8b9f-b180a43d9bea', 'volume_name': 'volume-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea', 'volume_size': 1, 'snapshot_id': '05b42aa3-53a5-4426-8cdd-f4e0e022f869'}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f056ac-80a8-4082-b56c-5787d64d625c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f056ac-80a8-4082-b56c-5787d64d625c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28f4c5c-64da-4d1d-8638-643884d12563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:12 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Volume 71b0f9bb-cf9d-453c-8b9f-b180a43d9bea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea', 'volume_size': 1, 'snapshot_id': '05b42aa3-53a5-4426-8cdd-f4e0e022f869'} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Acquiring lock "cinder-quobyte-05b42aa3-53a5-4426-8cdd-f4e0e022f869-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea" by "_create_volume_from_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Lock "cinder-quobyte-05b42aa3-53a5-4426-8cdd-f4e0e022f869-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Creating volume 71b0f9bb-cf9d-453c-8b9f-b180a43d9bea from snapshot 05b42aa3-53a5-4426-8cdd-f4e0e022f869 {{(pid=87568) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Selected osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29 as target Quobyte volume. {{(pid=87568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Acquiring lock "cinder-quobyte-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea" by "_copy_volume_from_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Lock "cinder-quobyte-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] snapshot: 05b42aa3-53a5-4426-8cdd-f4e0e022f869, volume: 71b0f9bb-cf9d-453c-8b9f-b180a43d9bea, {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e900c0-8be3-4566-8db7-e45578381f84]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:12 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-668db037-ce58-42d5-be92-7c3048fa3402 tempest-ProjectReaderTests-1874264973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1be10150-56a4-4927-81d3-08bb9ccb768b" returned: 0 in 0.381s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:12 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-668db037-ce58-42d5-be92-7c3048fa3402 tempest-ProjectReaderTests-1874264973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1be10150-56a4-4927-81d3-08bb9ccb768b {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:12 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1be10150-56a4-4927-81d3-08bb9ccb768b Jul 22 12:27:12 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:12 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869 Jul 22 12:27:12 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:13 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-668db037-ce58-42d5-be92-7c3048fa3402 tempest-ProjectReaderTests-1874264973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-1be10150-56a4-4927-81d3-08bb9ccb768b" returned: 0 in 0.262s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-668db037-ce58-42d5-be92-7c3048fa3402 tempest-ProjectReaderTests-1874264973 None] Lock "cinder-quobyte-1be10150-56a4-4927-81d3-08bb9ccb768b" released by "delete_volume" :: held 0.692s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:27:13 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-668db037-ce58-42d5-be92-7c3048fa3402 tempest-ProjectReaderTests-1874264973 None] Created reservations ['126b8bbd-6b90-4080-b47e-1daf708d16d6', 'a1ebb9aa-d001-4c78-86cb-fcc05ea4da7f', '2659ed08-83c1-4da4-8ba3-5c243e87d4ce', '4a1bcc1a-e144-4c94-890b-ed5dd4f76623'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:27:13 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869" returned: 0 in 0.376s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:27:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] will copy from snapshot at /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 12:27:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Creating direct copy from snapshot {{(pid=87568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 12:27:13 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[302609d2-acf5-4751-8e7c-f909bf288e5e]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:27:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-668db037-ce58-42d5-be92-7c3048fa3402 tempest-ProjectReaderTests-1874264973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:27:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-668db037-ce58-42d5-be92-7c3048fa3402 tempest-ProjectReaderTests-1874264973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:27:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-668db037-ce58-42d5-be92-7c3048fa3402 tempest-ProjectReaderTests-1874264973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:27:13 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-668db037-ce58-42d5-be92-7c3048fa3402 tempest-ProjectReaderTests-1874264973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:27:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-668db037-ce58-42d5-be92-7c3048fa3402 tempest-ProjectReaderTests-1874264973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:27:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-668db037-ce58-42d5-be92-7c3048fa3402 tempest-ProjectReaderTests-1874264973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:13 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:27:13 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:13 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e Jul 22 12:27:13 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:13 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-668db037-ce58-42d5-be92-7c3048fa3402 tempest-ProjectReaderTests-1874264973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.296s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:13 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-668db037-ce58-42d5-be92-7c3048fa3402 tempest-ProjectReaderTests-1874264973 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:27:13 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-668db037-ce58-42d5-be92-7c3048fa3402 tempest-ProjectReaderTests-1874264973 None] Deleted volume successfully. Jul 22 12:27:13 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-668db037-ce58-42d5-be92-7c3048fa3402 tempest-ProjectReaderTests-1874264973 None] Lock "cinder-1be10150-56a4-4927-81d3-08bb9ccb768b-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:27:13 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e" returned: 0 in 0.410s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:13 devstack cinder-volume[87568]: DEBUG cinder.utils [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Path /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea not found in is_blk_device check {{(pid=87568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 12:27:13 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:13 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea Jul 22 12:27:13 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:18 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea" returned: 0 in 4.612s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:18 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5b071a-f1f5-4b2b-896a-e0e5e6542f36]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:27:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:18 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e Jul 22 12:27:18 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:18 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e" returned: 0 in 0.510s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:18 devstack cinder-volume[87568]: DEBUG cinder.image.image_utils [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Image conversion details: src /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e, size 1024.00 MB, duration 4.61 sec, destination /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea {{(pid=87568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 12:27:18 devstack cinder-volume[87568]: INFO cinder.image.image_utils [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Converted 1024.00 MB image at 221.96 MB/s Jul 22 12:27:18 devstack cinder-volume[87568]: WARNING cinder.volume.drivers.remotefs [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea is being set with open permissions: ugo+rw Jul 22 12:27:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:18 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea Jul 22 12:27:18 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:18 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea" returned: 0 in 0.238s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:18 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Lock "cinder-quobyte-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea" released by "_copy_volume_from_snapshot" :: held 6.240s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:27:18 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Lock "cinder-quobyte-05b42aa3-53a5-4426-8cdd-f4e0e022f869-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea" released by "_create_volume_from_snapshot" :: held 6.270s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:27:18 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.287s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:27:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28f4c5c-64da-4d1d-8638-643884d12563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea', 'volume_size': 1, 'snapshot_id': '05b42aa3-53a5-4426-8cdd-f4e0e022f869'}' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:18 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c0c9b8-448a-48d6-84ef-cd7484e3b22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 12:27:19 devstack cinder-volume[87568]: INFO cinder.volume.flows.manager.create_volume [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Volume volume-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea (71b0f9bb-cf9d-453c-8b9f-b180a43d9bea): created successfully Jul 22 12:27:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c0c9b8-448a-48d6-84ef-cd7484e3b22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 12:27:19 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Flow 'volume_create_manager' (b3ea7fbb-278f-4416-8c22-d68f5f699f71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 12:27:19 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-701714c3-5de4-47b0-b066-43f1f4c35db5 tempest-SnapshotDependencyTests-143012724 None] Created volume successfully. Jul 22 12:27:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7037e79f-cf48-4f78-a6f3-a4c81567a558 tempest-SnapshotDependencyTests-143012724 None] Acquiring lock "cinder-05b42aa3-53a5-4426-8cdd-f4e0e022f869-delete_snapshot" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:27:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7037e79f-cf48-4f78-a6f3-a4c81567a558 tempest-SnapshotDependencyTests-143012724 None] Lock "cinder-05b42aa3-53a5-4426-8cdd-f4e0e022f869-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:27:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7037e79f-cf48-4f78-a6f3-a4c81567a558 tempest-SnapshotDependencyTests-143012724 None] Acquiring lock "cinder-quobyte-64bbea98-22c9-4cc7-8513-c3d8e2d6445e" by "delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:27:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7037e79f-cf48-4f78-a6f3-a4c81567a558 tempest-SnapshotDependencyTests-143012724 None] Lock "cinder-quobyte-64bbea98-22c9-4cc7-8513-c3d8e2d6445e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:27:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7037e79f-cf48-4f78-a6f3-a4c81567a558 tempest-SnapshotDependencyTests-143012724 None] Acquiring lock "cinder-quobyte-05b42aa3-53a5-4426-8cdd-f4e0e022f869" by "_delete_snapshot" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:27:19 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7037e79f-cf48-4f78-a6f3-a4c81567a558 tempest-SnapshotDependencyTests-143012724 None] Lock "cinder-quobyte-05b42aa3-53a5-4426-8cdd-f4e0e022f869" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:27:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-7037e79f-cf48-4f78-a6f3-a4c81567a558 tempest-SnapshotDependencyTests-143012724 None] Deleting offline snapshot 05b42aa3-53a5-4426-8cdd-f4e0e022f869 of volume 64bbea98-22c9-4cc7-8513-c3d8e2d6445e {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 12:27:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-7037e79f-cf48-4f78-a6f3-a4c81567a558 tempest-SnapshotDependencyTests-143012724 None] snapshot_file for this snap is: volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869 {{(pid=87568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 12:27:19 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[af30f1eb-5c4a-4391-8104-7b16ef12b7da]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:27:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7037e79f-cf48-4f78-a6f3-a4c81567a558 tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:19 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869 Jul 22 12:27:19 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:19 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7037e79f-cf48-4f78-a6f3-a4c81567a558 tempest-SnapshotDependencyTests-143012724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869" returned: 0 in 0.355s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:19 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.remotefs [None req-7037e79f-cf48-4f78-a6f3-a4c81567a558 tempest-SnapshotDependencyTests-143012724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 12:27:19 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b5bd4b-b633-48a8-adad-971400b913f5]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:27:19 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7037e79f-cf48-4f78-a6f3-a4c81567a558 tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:19 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e Jul 22 12:27:19 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:20 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7037e79f-cf48-4f78-a6f3-a4c81567a558 tempest-SnapshotDependencyTests-143012724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e" returned: 0 in 0.343s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7037e79f-cf48-4f78-a6f3-a4c81567a558 tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:20 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869 Jul 22 12:27:20 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:20 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7037e79f-cf48-4f78-a6f3-a4c81567a558 tempest-SnapshotDependencyTests-143012724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869" returned: 0 in 0.325s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7037e79f-cf48-4f78-a6f3-a4c81567a558 tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:20 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869 Jul 22 12:27:20 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:20 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:20 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-7037e79f-cf48-4f78-a6f3-a4c81567a558 tempest-SnapshotDependencyTests-143012724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e.05b42aa3-53a5-4426-8cdd-f4e0e022f869" returned: 0 in 0.240s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7037e79f-cf48-4f78-a6f3-a4c81567a558 tempest-SnapshotDependencyTests-143012724 None] Lock "cinder-quobyte-05b42aa3-53a5-4426-8cdd-f4e0e022f869" released by "_delete_snapshot" :: held 1.355s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:27:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7037e79f-cf48-4f78-a6f3-a4c81567a558 tempest-SnapshotDependencyTests-143012724 None] Lock "cinder-quobyte-64bbea98-22c9-4cc7-8513-c3d8e2d6445e" released by "delete_snapshot" :: held 1.376s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:27:20 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-7037e79f-cf48-4f78-a6f3-a4c81567a558 tempest-SnapshotDependencyTests-143012724 None] Created reservations ['222d73eb-e882-41c2-85ef-a3cc4b0b4078', 'bccca0b5-f92a-4115-9bb6-01218d3d1d51', 'b9bd9667-63ba-4130-9427-d6d9188b6140', '960df9fd-d0b3-46ed-8b77-07b3abda0602'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:27:20 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-7037e79f-cf48-4f78-a6f3-a4c81567a558 tempest-SnapshotDependencyTests-143012724 None] Delete snapshot completed successfully. Jul 22 12:27:20 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-7037e79f-cf48-4f78-a6f3-a4c81567a558 tempest-SnapshotDependencyTests-143012724 None] Lock "cinder-05b42aa3-53a5-4426-8cdd-f4e0e022f869-delete_snapshot" released by "delete_snapshot" :: held 1.502s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:27:21 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-700affab-7506-41ae-8962-66c4afbbd77e tempest-SnapshotDependencyTests-143012724 None] Acquiring lock "cinder-64bbea98-22c9-4cc7-8513-c3d8e2d6445e-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:27:21 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-700affab-7506-41ae-8962-66c4afbbd77e tempest-SnapshotDependencyTests-143012724 None] Lock "cinder-64bbea98-22c9-4cc7-8513-c3d8e2d6445e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:27:21 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-700affab-7506-41ae-8962-66c4afbbd77e tempest-SnapshotDependencyTests-143012724 None] Acquiring lock "cinder-quobyte-64bbea98-22c9-4cc7-8513-c3d8e2d6445e" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:27:21 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-700affab-7506-41ae-8962-66c4afbbd77e tempest-SnapshotDependencyTests-143012724 None] Lock "cinder-quobyte-64bbea98-22c9-4cc7-8513-c3d8e2d6445e" acquired by "delete_volume" :: waited 0.015s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:27:21 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bce156-a611-4bd8-8518-92d70d79ed45]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:27:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-700affab-7506-41ae-8962-66c4afbbd77e tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:21 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e Jul 22 12:27:21 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:21 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-700affab-7506-41ae-8962-66c4afbbd77e tempest-SnapshotDependencyTests-143012724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e" returned: 0 in 0.352s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:21 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-700affab-7506-41ae-8962-66c4afbbd77e tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:21 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e Jul 22 12:27:21 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:22 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-700affab-7506-41ae-8962-66c4afbbd77e tempest-SnapshotDependencyTests-143012724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-64bbea98-22c9-4cc7-8513-c3d8e2d6445e" returned: 0 in 0.243s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-700affab-7506-41ae-8962-66c4afbbd77e tempest-SnapshotDependencyTests-143012724 None] Lock "cinder-quobyte-64bbea98-22c9-4cc7-8513-c3d8e2d6445e" released by "delete_volume" :: held 0.649s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:27:22 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-700affab-7506-41ae-8962-66c4afbbd77e tempest-SnapshotDependencyTests-143012724 None] Created reservations ['f7f96370-f161-4042-a5ae-30f231505528', 'd120e64b-5e0e-4798-b7a1-dae978e4e1d3', '9922fdaf-a800-488a-9f62-1007f6d41b11', 'f527efbc-0a82-468d-b669-a32fb06851f7'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:27:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-700affab-7506-41ae-8962-66c4afbbd77e tempest-SnapshotDependencyTests-143012724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:27:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-700affab-7506-41ae-8962-66c4afbbd77e tempest-SnapshotDependencyTests-143012724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:27:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-700affab-7506-41ae-8962-66c4afbbd77e tempest-SnapshotDependencyTests-143012724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:27:22 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-700affab-7506-41ae-8962-66c4afbbd77e tempest-SnapshotDependencyTests-143012724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:27:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-700affab-7506-41ae-8962-66c4afbbd77e tempest-SnapshotDependencyTests-143012724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:27:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-700affab-7506-41ae-8962-66c4afbbd77e tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:22 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:27:22 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:22 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-700affab-7506-41ae-8962-66c4afbbd77e tempest-SnapshotDependencyTests-143012724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.242s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:22 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-700affab-7506-41ae-8962-66c4afbbd77e tempest-SnapshotDependencyTests-143012724 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:27:22 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-700affab-7506-41ae-8962-66c4afbbd77e tempest-SnapshotDependencyTests-143012724 None] Deleted volume successfully. Jul 22 12:27:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-700affab-7506-41ae-8962-66c4afbbd77e tempest-SnapshotDependencyTests-143012724 None] Lock "cinder-64bbea98-22c9-4cc7-8513-c3d8e2d6445e-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:27:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-dcc3633d-6be6-41ea-982b-bad10c5edd34 tempest-SnapshotDependencyTests-143012724 None] Acquiring lock "cinder-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea-delete_volume" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:27:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-dcc3633d-6be6-41ea-982b-bad10c5edd34 tempest-SnapshotDependencyTests-143012724 None] Lock "cinder-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:27:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-dcc3633d-6be6-41ea-982b-bad10c5edd34 tempest-SnapshotDependencyTests-143012724 None] Acquiring lock "cinder-quobyte-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea" by "delete_volume" {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 12:27:22 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-dcc3633d-6be6-41ea-982b-bad10c5edd34 tempest-SnapshotDependencyTests-143012724 None] Lock "cinder-quobyte-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea" acquired by "delete_volume" :: waited 0.015s {{(pid=87568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 12:27:22 devstack cinder-volume[87568]: DEBUG oslo.privsep.daemon [-] privsep: reply[9869e377-e3ae-4ac3-ab25-39907991c4c5]: (4, 'qcow2') {{(pid=88798) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 12:27:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dcc3633d-6be6-41ea-982b-bad10c5edd34 tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:22 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea Jul 22 12:27:22 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:22 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dcc3633d-6be6-41ea-982b-bad10c5edd34 tempest-SnapshotDependencyTests-143012724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea" returned: 0 in 0.355s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:22 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dcc3633d-6be6-41ea-982b-bad10c5edd34 tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:22 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea Jul 22 12:27:22 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:23 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dcc3633d-6be6-41ea-982b-bad10c5edd34 tempest-SnapshotDependencyTests-143012724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47/volume-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea" returned: 0 in 0.249s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-dcc3633d-6be6-41ea-982b-bad10c5edd34 tempest-SnapshotDependencyTests-143012724 None] Lock "cinder-quobyte-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea" released by "delete_volume" :: held 0.641s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:27:23 devstack cinder-volume[87568]: DEBUG cinder.quota [None req-dcc3633d-6be6-41ea-982b-bad10c5edd34 tempest-SnapshotDependencyTests-143012724 None] Created reservations ['aeabe646-3e2a-455b-81bb-dd6a1db47edc', '49a060da-c1e8-4ac3-aa30-481965d14aef', '68b6ec27-db4d-49a6-ba9b-6efbe013d3d4', '8c68621b-5fa1-451a-93d5-dc686a95a099'] {{(pid=87568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 12:27:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dcc3633d-6be6-41ea-982b-bad10c5edd34 tempest-SnapshotDependencyTests-143012724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:27:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dcc3633d-6be6-41ea-982b-bad10c5edd34 tempest-SnapshotDependencyTests-143012724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:27:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-dcc3633d-6be6-41ea-982b-bad10c5edd34 tempest-SnapshotDependencyTests-143012724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:27:23 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-dcc3633d-6be6-41ea-982b-bad10c5edd34 tempest-SnapshotDependencyTests-143012724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:27:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-dcc3633d-6be6-41ea-982b-bad10c5edd34 tempest-SnapshotDependencyTests-143012724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:27:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dcc3633d-6be6-41ea-982b-bad10c5edd34 tempest-SnapshotDependencyTests-143012724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:23 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:27:23 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:23 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:23 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-dcc3633d-6be6-41ea-982b-bad10c5edd34 tempest-SnapshotDependencyTests-143012724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.240s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:23 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-dcc3633d-6be6-41ea-982b-bad10c5edd34 tempest-SnapshotDependencyTests-143012724 None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:27:23 devstack cinder-volume[87568]: INFO cinder.volume.manager [None req-dcc3633d-6be6-41ea-982b-bad10c5edd34 tempest-SnapshotDependencyTests-143012724 None] Deleted volume successfully. Jul 22 12:27:23 devstack cinder-volume[87568]: DEBUG cinder.coordination [None req-dcc3633d-6be6-41ea-982b-bad10c5edd34 tempest-SnapshotDependencyTests-143012724 None] Lock "cinder-71b0f9bb-cf9d-453c-8b9f-b180a43d9bea-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 12:27:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:27:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 12:27:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 12:27:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29': None} {{(pid=87568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 12:27:24 devstack cinder-volume[87568]: DEBUG cinder.volume.drivers.quobyte [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2c9a58a-cd3b-4fc2-82d4-64c8e9e7ae29'] {{(pid=87568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 12:27:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.lockutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 12:27:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 12:27:24 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47 Jul 22 12:27:24 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 12:27:24 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 22 12:27:24 devstack cinder-volume[87568]: DEBUG oslo_concurrency.processutils [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/06f293d3f0b5b865d603527b0f6bdd47" returned: 0 in 0.254s {{(pid=87568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 12:27:24 devstack cinder-volume[87568]: DEBUG cinder.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Notifying Schedulers of capabilities ... {{(pid=87568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 12:27:24 devstack cinder-volume[87568]: DEBUG oslo_service.periodic_task [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=87568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 12:27:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread count: 28 {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 12:27:24 devstack cinder-volume[87568]: DEBUG cinder.volume.manager [None req-0eae7da0-d42f-43eb-a7a1-dc594698d6aa None None] thread info: [<_MainThread(MainThread, started 137793405739136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 12:27:33 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:UPDATE=75,cinder:SELECT=54,cinder:INSERT=17,cinder:DELETE=7 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 12:27:33 devstack cinder-volume[87568]: DEBUG dbcounter [-] [87568] Writing DB stats cinder:SELECT=49,cinder:INSERT=17,cinder:UPDATE=69,cinder:DELETE=6 {{(pid=87568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}